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ABSTRACT. In this paper wc introduce a general framework for the study of 
limits of relational structures in general and graphs in particular, which is 
based on model theory and analysis. We show how the various approaches to 
graph limits fit to this framework and that they naturally appear as "tractable 
cases" of a general theory. As an outcome of our theory, we provide extensions 
of known results and identify some new cases exhibiting specific properties 
suggesting that their study could be more accessible than the full general 
case. The second part of the paper is devoted to the study of such a case, 
namely limits of graphs (and structures) with bounded diameter connected 
components. We prove that in this case the convergence can be "almost" 
studied component- wise. Eventually, we consider the specific case of limits of 
graphs with bounded tree-depth, motivated by their role of elementary brick 
these graphs play in decompositions of sparse graphs, and give an explicit 
construction of a limit object in this case. This limit object is a graph built on a 
standard probability space with the property that every first-order definable set 
of tuples is measurable. This is an example of the general concept of modeling 
we introduce here. It is also the first "intermediate class" with explicitly 
defined limit structures. 
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1. Introduction 

To facilitate the study of the asymptotic properties of finite graphs in a sequence 
G\, G2, ■ • ■ , G n , . . ., it is natural to introduce notions of structural convergence. By 
structural convergence, we mean that we are interested in the characteristics of a 
typical vertex (or group of vertices) in the graph G n , as n grows to infinity. This 
convergence can, for instance, be expressed by the convergence of the properties' 
distributions. It may also be the case that they can be obtained by sampling 
either a measurable limit graph, or a random limit graph defined by means of edge 
probabilities (or densities). 

While the later case corresponds in particular to graphons (limit objects intro- 
duced by Lovasz et al. [TTJ [TJJ to study extremal properties of dense graphs 
based on subgraph statistics), the former case corresponds in particular to graph- 
ing (limit objects for Benjamini-Schramm convergence of graphs with bounded 
degrees [51 [23], which is based of vertex neighbourhood statistics). Both mod- 
els are probabilistic in that they count statistics of subgraphs (or equivalently of 
homomorphisms) . 

It seems that the existential approach typical for decision problems, structural 
graph theory and model theory on the one side and the counting approach typical 
for statistics and probabilistic approach on the other side have nothing much in 
common and lead to different directions: on the one side to study, say, definability 
of various classes and the properties of the homomorphism order and on the other 
side properties of partition functions. It has been repeatedly stated that these 
two extremes are somehow incompatible and lead to different area of study (see 

e.g. HJHI33I). 

In this paper we take a radically different approach: We propose a model which 
is a mixture of the analytic, model theoretic and algebraic approach. It is also a 
mixture of existential and probabilistic approach: typically what we count is the 
probability of existential extension properties. Precisely, our approach is based on 
the Stone pairing (</>, G) of a first-order formula 4> (with set of free variables Fv(<^>)) 
and a graph G, which is defined by following expression 

, , r , _ IIK ■ ■ • ,"|Fv W |) 6 G' Fv ^' : G h ^i, ■ ■ ■ , v\ FvW \)}\ 
W>>W |G||Fv«,)| 

A sequence of graphs (G„)„ s n is FO-convergent if, for every first order formula 
4> (in the language of graphs), the values {<f>,G n } converge as n — > oo. In other 
words, (G„)„ e N is FO-convergent if the probability that a formula <j> is satisfied 
by the graph G„ with a random assignment of vertices of G n to the free variables 
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of 4> converges as n grows to infinity. We also consider analogously defined X- 
convergence, where X is a fragment of FO. 

Our main result is that this model of FO-convergence is a suitable model for 
the analysis of limits of graphs with bounded tree depth. This class of graphs 
can be defined by logical terms as well as combinatorially in various ways. The 
most concise definition is that a class of graphs has bounded tree depth if and only 
if the maximal length of a path in every G in the class is bounded by a constant. 
Tree depth is related to the quantifier depth of a formula and to other combinatorial 
characteristics, see [50] and [ST] for a full discussion. The convergence of graphs with 
bounded tree depth is analysed in detail and this leads to explicit limits for those 
sequences of graphs where all members of the sequence have uniformly bounded tree 
depth (see Theorem 27 1 . One may argue that this is a rather special class of graphs. 
But we believe that this is not so and that there is here more than meets the eye. 
Let us outline the reasons for this optimism: For graphs, and more generally for 
finite structures, there is a class dichotomy: nowhere dense and somewhere dense 
[551157] , Each class of graphs falls in one of these two categories. Somewhere dense 
class C may be characterised by saying that there exists a (primitive positive) FO 
interpretation of all graphs into them. Such class C is inherently a class of dense 
graphs. On the other hand any nowhere dense class of structures may by covered by 
a few subgraphs with small tree depth. This is called low tree-depth decomposition 
and it found many applications in structural graphs theory, see e.g. [61j for more 
information about this development. Thus graphs with bounded tree depth form 
building blocks of graphs in a nowhere dense class. So in this setting the solution 
of limits for graphs with bounded tree depth presents a step in solving the general 
limits for sparse graphs. 

To create a proper model for bounded height trees we have to introduce the 
model in a greater generality and it appeared that our approach relates and in 
most cases generalizes all existing models of graph limits. 

Our unified framework to study structural limits of general relational structures 
and limits of graphs (in particular) via A-convergence generalizes most instances 
of graph limits considered previously. For instance, for the fragment X of all 
existential first-order formulas, X-convergence means that the probability that a 
structure has any given extension property converges. Our approach is encouraged 
by the deep connections to four notions of convergence which have been proposed 
to study graph limits in different contexts. 

The first of these is the combinatorially motivated notion of convergence intro- 
duced by Lovasz and Szegedy [H] and further developed by Borgs, Chayes, Lovasz, 
Sos and Vesztergombi [TT] [J5] . This notion is established by equipping the space 
of (unlabelled) graphs with a suitable metric, and by considering convergent se- 
quences defined as Cauchy sequences in the completion of this metric space. In 
this setting, a classic representation of the limit [15] [TT] is a symmetric Lebesgue 
measurable function W : [0, l] 2 — > [0, 1] called graphon. Such a representation is of 
course not unique, in the sense that different graphons may define the same graph 
limit [H[TB]. A connection between graph limits and de Finetti's theorem for ex- 
changeable arrays (and the early works of Aldous [2], Hoover [37] and Kallenberg 
[35]) has been established, see e.g. Diaconis and Janson PJj]. This convergence 
corresponds to X-convergence with respect to the fragment of all quantifier free 
formulas (see Section 4.1). 

A second approach to graph limits, which concerns specifically connected graphs 
with bounded degrees, has been developed by Benjamini and Schramm [6] and 
Aldous [3j. In this case, the limit of a convergent sequence is described as an 
unimodular distribution of the space of rooted connected countable graphs with 
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bounded degree (equipped with a suitable metric and the derived cr-algebra). A 
representation of the limit is a measurable graphing (notion introduced by Adams [1] 
in the context of Ergodic theory) , that is a standard Borel space with a measure /z 
and d measure preserving Borel involutions. The existence of such a representation 
has been made explicit by Elek [23], and relies on the works of Benjamini [5] and 
Gaboriau [25] . This convergence corresponds to A-convergence with respect to the 
fragment of all local formulas (see Section 4.2 1. 

A third (but earlier) theory of limits of structures, by means of elementary con- 
vergence, derives from two important results in first-order logic, namely Godcl's 
completeness theorem and the compactness theorem. This notion of convergence, 
based on the satisfaction of first-order sentences, can also be expressed by embed- 
ding graphs in the space of complete theories (in the language of graphs) and by 
equipping this space with an ultrametric derived from the quantifier rank. In this 
setting, a limit is a complete theory, which can be represented by a model and, in 
this case, the limit of a sequence of graphs can be represented by a countable graph. 
This convergence corresponds to A-convergence with respect to the fragment of all 
sentences (see Section 4.3). 

Finally, a notion of limit developed by the authors has been introduced, which 
is based on the existence of homomorphisms from small graphs |58| 16 lj . 

In this paper, we shed a new light on model theoretical constructions by an 
approach inspired by functional analysis. The preliminary material and our frame- 
work are introduced in Sections [2] and [3] The general approach presented in the 
first sections of this paper leads to several new results. Some of them intuitively 
motivate and, we believe, justify the introduction of first-order formulas. Let us 
mention a sample of such results. 

Graph limits (in the sense of Lovasz et al.) — and more generally hypergraph 
limits — have been studied by Elek and Szegedy [M] through the introduction of 
a measure on the ultraproduct of the graphs in the sequence (via Loeb measure 
construction, see [42]). The fundamental theorem of ultraproducts proved by Los 
[43j implies that the ultralimit of a sequence of graphs is (as a measurable graph) 
an FO-limit. Thus in this non-standard setting we get FO-limits (almost) for free. 

Central to the theory of graph limits stand random graphs (in the Erdos-Renyi 
model [2*5]): a sequence of random graphs with increasing order and edge proba- 
bility < p < 1 is almost surely convergent to the constant graphon p [46]. On 
the other hand, it follows from the work of Erdos and Renyi [26] that such a se- 
quence is almost surely elementarily convergent to an ultra-homogeneous graph, 
called the Rado graph. We prove that these two facts, together with the quanti- 
fier elimination property of ultra-homogeneous graphs, imply that a sequence of 
random graphs with increasing order and edge probability < p < 1 is almost 



surely FO-convergent, see Section 5.3 (However, it is presently open whether a 
representation of the limit exists, that would be as nice as a graphon.) 

We shall also prove that a sequence of bounded degree graphs (G„)„ e N with 
\G n \ — > oo is FO-convergent if and only if it is both convergent in the sense of 
Benjamini-Schramm and in the sense of elementary convergence, and that the limit 
can still be represented by a graphing, see Sections |4.2| and |7.4[ 

We prove that the limit of an FO-convergent sequence of graphs is a probability 
measure on the Stone space of the Boolean algebra of first-order formulas, which 
is invariant under the action of S u on this space, see Section [3] Fine interplay of 
these notions is depicted on Table [l] 

One of the main issue of our general approach is to determine a representation 
of FO-limits as measurable graphs. A natural limit object is a standard probability 
space (V, £,At) together with a graph with vertex set V and edge set E, with the 
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Boolean algebra B(X) Stone Space S(B(X)) 



Formula (f> 


Continuous function Ja 


Vertex v 


type ot vertex 1 


Graph G 


statistics of types 
=probability measure [Iq 


(0,G> 


J U(T) d MG (T) 


A-convergent (G n ) 


weakly convergent HG n 


T = Aut(B(X)) 


T-invariant measure 



Table 1. Some correspondances 



property that every first-order definable subset of a power of V is measurable. 
This leads to the notions of relational sample space and modeling. Relying on our 
general approach, we consider the problem of the representation of FO-convergent 
sequences of graphs with bounded diameter connected components, and specifically 
the representation of FO-convergent sequences of graphs with bounded tree-depth 
|50j . This study is motivated by the structural simplicity of these graphs and the 
central role they play in the context of sparse graph decompositions (5TJ |52j [53j [61] 
and in first-order quantifier elimination schemes for bounded expansion classes of 
graphs [501 GH| . The special case of FO-limits of graphs with bounded tree-depth 
should be regarded as a first step toward a representation of FO-limits of graphs 
belonging to arbitrary fixed bounded expansion class, like planar graphs, or graphs 
excluding a topological minor. Combining low tree-depth decomposition techniques 
with the results of this paper gives us a "road map" to attack the general classes 
of sparse graphs (see remarks in the last section of this paper) . 

The class of graphs with bounded tree-depth is one of the first "intermediate 
cases" [3HI1S] for which one can explicitly describe a limit object. The only other 
case we are aware is Lyons [UJ , which is concerned by a slight relaxation of the con- 
dition to have bounded degree to the condition that — roughly speaking — large 
degrees are far away from almost all other vertices (so that the asymptotic distri- 
bution of rooted finite graphs found at a random vertex converges to a probability 
distribution); this does not apply, for instance, for sequences of connected graphs 
with bounded diameters. Also, the scaling limit of vertex transitive graphs with 
sufficiently fast growing diameter has been characterized recently [5], but scaling 
limits and structural limits are in some sense orthogonal concepts. 

We believe that the approach taken in this paper is natural and that it enriches 
the existing notions of limits. It also presents, for example via decomposition 
techniques (low-tree depth decomposition, see [61] ) a promising approach to more 
general intermediate classes (see the final comments). 

The outline of the paper is as follows: 

• In Section [2] we introduce main definitions and results of the paper. 

• In Section [3] we recall some relevant properties of Boolean algebras. To 
each Boolean algebra B — considered as a algebra of sets — we associate 
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the Banach space ba(B) of all bounded and finitely additive measures on 
B. We note that ba(-B) is isometrically isomorphic to the continuous dual 
ica,(S(B)) of the Banach C(S(B)) of the continuous real-valued functions 
defined on the Stone space S(B) dual to B, and deduce that the space 
additive functions on B (with pointwise convergence) is isomorphic to the 
space of regular countably additive measures on S(B) (with weak-* conver- 
gence). Then we show that if a notion of independence is introduced in B 
together with a suitable group action, then we can deduce that pointwise 
limits of symmetric normalized positive additive functions on B that are 
multiplicative on independent elements correspond to symmetric probabil- 
ities on the Stone space of B allowing particular disintegrations. Then we 
recall some basics of model theory and introduce our unified framework for 
structural limits. We introduce the pairing of a first-order formula and a 
finite structure and the notion of X-convergence for a fragment X of FO 
and we translate our results to this framework. Thus this correspondence 
is an alternative and very general approach to measure theoretic aspects of 
limits. 

In Section [4] we express the classical notions of limits in terms of conver- 
gences controlled by proper fragments of FO and deduce the particular role 
of elementary convergence. We further study the properties of the Stone 
spaces associated to diverse fragments of FO. Under the assumption that 
a sequence of connected graphs with degree at most D (with order tend- 
ing to infinity) is elementary convergent, we prove that FO-convergence is 
equivalent to Benjamini-Schramm convergence. Also, we prove that un- 
der the assumption that a sequence of graphs is elementary convergent to 
a countable ultra-homogeneous graph the FO-convergence is equivalent to 
Lovasz convergence. Note that this condition on the elementary limit is not 
as strong as it may seem at first glance, as random graphs almost surely 
converge elementarily to the Rado graph. 

In Section [5] we study how different fragments combine. For instance, we 
study the FO p -hierarchy, and the particular roles of local formulas and 
sentences. 

In Section [6] we consider a non-standard approach to construct a limit 
object. 

In Section [7] we introduce the notions of relational sample space and of 

modeling. We prove that in the particular case of graphs with bounded 

degrees, the notion of modeling coincides with the notion of graphing, and 

that every FO-convergent sequence admits a modeling as a limit. 

In Section [S] we study how modeling limits of FO-convergent sequences can 

be merged into a modeling limit of the index-wise union of the sequences. 

In Section[9]we study limits of sequences of disconnected graphs and address 

the problem of tracking the connected components till the limit. 

In Section[lO]we focus on the the class of rooted colored trees with bounded 

height. We give an explicit description of a relational sample space of a 

modeling FO-limit for graphs in this class. 

In Section [TT] we introduce the class of graphs with bounded tree-depth 
and show how a proper encoding and the use of a basic interpretation 
scheme can be used to reduce the problem of finding a modeling FO-limit 
for FO-convergent sequences of graphs with uniformly bounded tree-depth 
to a similar problem on vertex-colored rooted trees with uniformly bounded 
height. 

Section [12] is devoted to concluding remarks and discussion. 
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2. Main Definitions and Results 



If we consider relational structures with signature A, the symbols of the relations 
and constants in A define the non-logical symbols of the vocabulary of the first-order 
language FO(A) associated to A-structures. Notice that if A is at most countable 
then FO(A) is countable. The symbols of variables will be assumed to be taken 
from a countable set {x\, ...,£„,...} indexed by N. Let u\,...,Uk be terms. The 
set of used free variables of a formula <f> will be denoted by Fv(0) (by saying that a 
variable Xj is "used" in <f> we mean that 4> is not logically equivalent to a formula in 
which Xi does not appear). The formula <p Xii ,..., Xi {ui, ■ ■ ■ , denote the formula 
obtained by substituting simultaneously the term Uj to the free occurences of Xi j 
for j = l,...,fc. In the sake of simplicity, we will denote by <j>(ui, . . . , Uk) the 
substitution <j> Xl> ... tXh {ui, . . . ,u k ). 

A relational structure A with signature A is defined by its domain (or universe) 
A and relations with names and arities as defined in A. In the following we will 
denote relational structures by bold face letters A, B, . . . and their domains by the 
corresponding light face letters A, B, . . . 

The key to our approach are the following two definitions. 

Definition 1 (Stone pairing). Let A be a signature, let <j> £ FO(A) be a first-order 
formula with free variables x±, . . . ,x p and let A be a finite A-structure. 



In other words, (cj), A) is the probability that <j) is satisfied in A when we inter- 
pret the p free variables of <f> by p vertices of G chosen randomly, uniformly and 
independently. 

Note that in the case of a sentence <j) (that is a formula with no free variables, 
thus p = 0), the definition of the Stone pairing reduces to 



Definition 2 (FO-convergence) . A sequence (A„)„ s n of finite A-structures is FO- 
convergent if, for every formula <j> £ FO(A) the sequence ((<j>, A„))„ £ n is (Cauchy) 
convergent. 

In other words, a sequence (A„)„ £ n is FO-convergent if the sequence of mappings 
( • , A„) : FO(A) — > [0, 1] is pointwise-convergent. 

The interpretation of the Stone pairing as a probability suggests to consider 
finite A-structures as particular probability spaces and to extend this view to more 
general A-structures. 

Definition 3 (Relational sample space). A relational sample space is a relational 
structure A (with signature A) with extra structure: The domain A of A of a sample 
model is a standard Borel space (with Borel a- algebra E^) with the property that 
every subset of A p that is first-order definable in FO(A) is measurable (in A v with 
respect to the product cr-algebra). 



Let 



fy(A) = {(«i, ...,v p )£A p : Ah <P(V!, . . . , «p)}. 
We define the Stone pairing of <f> and A by 



(1) 
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In other words, if A is a relational sample space then for every integer p and 
every <j) £ FO(A) with p free variables it holds fi^(A) £ £ A . 



Definition 4 (Modeling). A modeling A is a relational sample space equipped with 
a probability measure (denoted //a)- 

A modeling with signature A is a X-modeling. 



Remark 1. We take time for some comments on the above definitions: 

• According to Kuratowski's isomorphism theorem, the domains of relational 
sample spaces are isomorphic to either R, Z, or a finite space. 

• Borel graphs (in the sense of Kechris et al. |39j ) are generally not model- 
ings (in our sense) as Borel graphs are only required to have a measurable 
adjacency relation. 

• By equipping its domain with the discrete er-algebra, every finite A-structure 
defines with a relational sample space. Considering the uniform probability 
measure on this space then canonically defines a weakly uniform modeling. 

• It follows immediately from Definition [3] that any k-rooting of a relational 
sample space is a relational sample space. 

We extend the definition of Stone pairing to modelings as follows. 



Definition 5 (Stone pairing). Let A be a signature, let <f> £ FO(A) be a first-order 
formula with free variables x\, . . . ,x p and let A be a A- modeling. 
We define the Stone pairing of <f> and A by 

(2) (&A)=/ l^ (A) {x)Avl{x). 



Note that the definition of a modeling is simply forged to make the expres- 
sion ([2]) meaningful. Based on this definition, modelings can sometimes be used as 
a representation of the limit of an FO-convergent sequence of finite A-structures. 



Definition 6. A modeling L is a modeling FO-limit of an FO-convergent sequence 
(A n ) n6 fj of finite A-structures if ( • , A„) converges pointwise to ( • , L). 



As we shall see in Lemma 17 a modeling FO-limit of an FO-convergent sequence 
(A n )i»eN °f finite A-structures is necessarily weakly uniform. It follows that if a 
modeling L is a modeling FO-limit then L is either finite or uncountable. 

It is not clear whether every FO-convergent sequence of finite relational struc- 
tures admits a modeling FO-limit, and we strongly believe this is not the case. 
However, we prove that modeling FO-limits exist in two particular cases. 



Theorem 1. Let C be a integer. 

(1) Every FO-convergent sequence of graphs with maximum degree at most C 
has a modeling FO-limit; 

(2) Every FO-convergent sequence of rooted trees with height at most C has a 
modeling FO-limit. 



While the first item will be derived from the graphing representation of limits 
of Bcnjamini-Schramm convergent sequences of graphs with bounded maximum 
degree with no major difficulties, the second item will be quite difficult to establish 
and is the main result of this paper. 
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As mentioned earlier, we do not know if a modeling FO-limit exists in general. 
However, a non-standard approach allows to define a limit object by relaxing the 
requirement that the domain of the limit structure is a standard probability space 
and by replacing — in the definition of the Stone pairing — the integration the 
product space by an iterated integration on the domain. 

Theorem 2. Let (A n )„ e m be an FO-convergent sequence of X-structures. Then 
there exists a X-structure L such that the domain of L is a (non-separable) prob- 
ability space with probability measure v , such that for every first-order formula 
4> G FO(A) with free variables Xi, . . . , x p it holds: 



lim (<j), A n ) = 

n— >oo 




. . . , x p ) dv(xi) . . . du(x p ). 



A 



This kind of limit object is however not completely satisfactory, and we shall 
usually prefer to have a general representation of the limit of an FO-convergent 
sequence of A-structures by means of a probability distribution on a compact Polish 
space S\ defined from FO(A) using Stone duality. In this context we have the 
following result: 

Theorem 3. Let X be a fixed finite or countable signature. Then there exist two 
mappings A t— > /za and <f> <— > K(<j)) such that 

• An fiA is an injective mapping from the class of finite X-structures to the 
space of regular probability measures on S\, 

K((j>) is a mapping from FO(A) to the set of the clopen subsets of S\, 
such that for every finite X-structure A and every first- order formula (f> S FO(A) it 
holds: 

(4>, A) = / d/i A - 

(To prevent risks of notational ambiguity, we shall use /i as root symbol for 
measures on Stone spaces and keep v for measures on modelings.) 

Consider an FO-convergent sequence (A„)„ 6 n- Then the pointwise convergence 
of ( • , A„) translates as a weak *-convergence of the measures /ia„ and we get: 

Theorem 4. //(A n ) nS N is an FO-convergent sequence of finite X-structures there 
exists a unique regular probability measure /i on S\ such that for every first-order 
formula <fi € FO(A) it holds: 

lim (0, A„) = / l K u) dfi. 



3. Limits as Measures on Stone Spaces 

In order to prove the representation theorems Theorem [3] and Theorem[4j we first 
need to prove a general representation for additive functions on Boolean algebras. 

3.1. Representation of Additive Functions. Recall that a Boolean algebra B = 
{B, A, V, -i, 0, 1) is an algebra with two binary operations V and A, a unary operation 
-i and two elements and 1, such that (B, V, A) is a complemented distributive 
lattice with minimum and maximum 1. The two-elements Boolean algebra is 
denoted 2. 
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To a Boolean algebra B is associated a topological space, denoted S(B), whose 
points are the ultrafiltcrs on B (or equivalently the homomorphisms B — > 2). The 
topology on S(B) is generated by a sub-basis consisting of all sets 

K B (b) = {xES(B):bEx}, 

where b E B. When the considered Boolean algebra will be clear from context we 
shall omit the subscript and write K(b) instead of Ks(b). 

A topological space is a Stone space if it is Hausdorff, compact, and has a basis 
of clopen subsets. Boolean spaces and Stone spaces are equivalent as formalized 
by Stone representation theorem [51], which states (in the language of category 
theory) that there is a duality between the category of Boolean algebras (with 
homomorphisms) and the category of Stone spaces (with continuous functions). 
This justifies to call S(B) the Stone space of the Boolean algebra B. The two 
contravariant functors defining this duality are denoted by S and and defined as 
follows: 

For every homomorphism h : A — > B between two Boolean algebra, we define the 
map S(h) : S(B) -» S(A) by S(h)(g) — g oh (where points of S(B) are identified 
with homomorphisms g : B — > 2). Then for every homomorphism h : A — >■ B 7 the 
map S(h) : S(B) — ► S(A) is a continuous function. 

Conversely, for every continuous function / : X — > Y between two Stone spaces, 
define the map Q(f) : Cl(Y) -> Q(X) by Q(f)(U) = f^(U) (where elements 
of Sl(X) are identified with clopen sets of X). Then for every continuous function 
/ : X — > Y, the map f2(/) : &(Y) — > fl(X) is a homomorphism of Boolean algebras. 

We denote by K = 51 o S one of the two natural isomorphisms defined by the 
duality. Hence, for a Boolean algebra B, K(B) is the set algebra {KB(b) : b E B}, 
and this algebra is isomorphic to B. 

An ultrafilter of a Boolean algebra B can be considered as a finitely additive 
measure, for which every subset has either measure or 1. Because of the equiv- 
alence of the notions of Boolean algebra and of set algebra, we define the space 
ba(£?) as the space of all bounded additive functions / : B — > K.. Recall that a 
function / : B — > K is additive if for all x, y E B it holds 

xAy = =>■ f(xVy)=f(x) + f(y). 

The space b&(B) is a Banach space for the norm 

ll/l|ba(B) = sup/(x) - inf f(x). 

(Recall that the ba space of an algebra of sets S is the Banach space consisting of 
all bounded and finitely additive measures on S with the total variation norm.) 

Let V{B) be the normed vector space (of so-called simple functions) generated 
by the indicator functions of the clopen sets (equipped with supremum norm) . The 
indicator function of clopen set K(b) (for some b E B) is denoted by 1^(6)- 

Lemma 1. The space h&(B) is the topological dual ofV(B) 

Proof. One can identify h&(B) with the space b&(K(B)) of finitely additive measure 
defined on the set algebra K(B). As a vector space, ba(-B) ~ ha,(K{B)) is then 
clearly the (algebraic) dual of the normed vector space V(B). 

The pairing of a function / E ba(B) and a vector X = 537=1 a i^-K(b ) is defined 

by 

n 

[/,*] = 

i=l 

That [/, X] docs not depend on a particular choice of a decomposition of X follows 
from the additivity of /. We include a short proof for completeness: Assume 
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E* onl K(bi) = E< ftlxcfcO- As for evei T b,b' eB it holds /(&) - f(bAb')+f(bA^b>) 
and ljr(6) = 1k(6a6') + ljr(6A-.b') we can express the two sums as Ei a^lj<-(6'.) = 
Ej (where b[ Ab'j — for every i j), with £ ( Oi/(&0 = Ej ^/(fc^and 

E;/W) = Ej P'jf( b 'j)- As ^ A 6;- = for every t ^ j, for x G JT(&J) it holds 
a$ = = 0'.. Hence a$ = $ for every j. Thus E, <*/(&() = £V &/(&*)• 

Note that X H> [/, X] is indeed continuous. Thus ba(B) is the topological dual 
ofV(B). □ □ 

Lemma 2. TTie vector space V(B) is dense in C(5(B)) (with the uniform norm). 

Proof. Let / G C(S(B)) and let e > 0. For z G /(5(B)) let be the preimage 
by / of the open ball B e / 2 (z) of R centered in z. As / is continuous, U z is a open 
set of S(B). As {iC(6) : b G B} is a basis of the topology of S(B), U z can be 
expressed as a union U&eJW*) It follows that Uze/(S(B)1 Ube-FfU,) ^(^) ^ s 

a covering of 5(B) by open sets. As S(B) is compact, there exists a finite subset 
°f U Z £/(s(s)) -^(^) tn at covers 5(B). Moreover, as for every b,b' & B it holds 
#(&) n K(b') = K{b A &') and K(b) \ K{b') = K{b A -.&') it follows that we can 
assume that there exists a finite family J 7 ' such that S(B) is covered by open sets 
K{b) (for b G J 7 ') and such that for every 6 G T' there exists 6' G T such that 
i£"(6) C K{b'). In particular, it follows that for every 6 G J 7 ', f(K(b)) is included 
in an open ball of radius e/2 of K. For each b £ T' choose a point X\, G 5(B) such 
that b £ x b . Now define 

/ = 51 /(zb)l*r(&) 
Let x G 5(B). Then there exists be J' such that cc G if(&). Thus 

|/(z) -/>)| = I/O*) " /(*&)!<* 
Hence ||/ - /IU < e. □ □ 

Lemma 3. Let B be a Boolean algebra, let ba(B) be the Banach space of bounded 
additive real-valued functions equipped with the norm \\f\\ = sup &gB fib)— mibeB f(b), 
let 5(B) be the Stone space associated to B by Stone representation theorem, and let 
rca(5(B)) be the Banach space of the regular countably additive measure on 5(B) 
equipped with the total variation norm. 

Then the mapping Ck ■ rca(5(B)) — > ba(B) defined by Ca'(m) = // ° K is an 
isometric isomorphism. In other words, Ck is defined by 

C K {ii){b) = fi({x G 5(B) : be x}) 

(considering that the points of 5(B) are the ultrafilters on B). 

Proof. According to Lemma [I] the Banach space ba(B) is the topological dual of 
V{B) and as V(B) is dense in C(5(B)) (according to Lemma [2]) we deduce that 
ba(B) can be identified with the continuous dual of C(5(B)). By Riesz represen- 
tation theorem, the topological dual of C(5(B)) is the space rca(5(B)) of regular 
countably additive measures on 5(B). From these observations follows the equiva- 
lence of ba(B) and rca(5(B)). 

This equivalence is easily made explicit, leading to the conclusion that the map- 
ping Ck ■ rca(5(B)) — » ba(B) defined by Ck{^) — H ° K is an isometric isomor- 
phism. □ □ 

Note also that, similarly, the restriction of Ck to the space Pr(5(B)) of all 
(regular) probability measures on 5(B) is an isometric isomorphism of Pr (5(B)) 
and the subset bai(B) of ba(B) of all positive additive functions / on B such that 
/(!) = !• 
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Recall that given a measurable function / : X — > Y (where X and Y are mea- 
surable spaces), the pushforward of a measure [i on X is the measure on Y 
defined by f*(fi)(A) — (for every measurable set A of Y). Note that if 
/ is a continuous function and if fj, is a regular measure on X , then the pushfor- 
ward measure f*(fi) is a regular measure on Y. By similarity with the definition of 
51(/) : £1(F) — > n(X) (see above definition) we denote by fi*(/) the mapping from 
rca(X) to rca(F) defined by (£1* (/))(/i) = /*(/i). 

All the functors defined above are consistent in the sense that if h : A — > B is a 
homomorphism and / £ ba(i?) then 

il*(S(h))( t lf)oK A =foh = T h (f). 

A standard notion of convergence in rc&(S(B)) (as the continuous dual of C(S(B))) 
is the weak ^-convergence: a sequence (p n )neN of measures is convergent if, for ev- 
ery / £ C(S(B)) the sequence J f(x)dfj, n (x) is convergent. Thanks to the density 
of V(B) this convergence translates as pointwise convergence in ba(-B) as follows: 
a sequence (g n )nefi of functions in ba(_B) is convergent if, for every b £ B the se- 
quence (<7„(6))„ e N is convergent. As ica,(S(B)) is complete, so is rca(£>). Moreover, 
it is easily checked that bai(-B) is closed in ba(-B). 

In a more concise way, we can write, for a sequence (f n )neN of functions in ba(_B) 
and for the corresponding sequence (/z^JngN of regular measures on S(B): 

lim /„ pointwise •<=>• fit => fit, 

3.2. Basics of Model Theory and Lindenbaum-Tarski Algebras. We denote 
by B(FO(A)) the equivalence classes of FO(A) defined by logical equivalence. The 
(class of) unsatisfiable formulas (resp. of tautologies) will be designated by (resp. 
1). Then, B(FO(X)) gets a natural structure of Boolean algebra (with minimum 0, 
maximum 1, infinium A, supremum V, and complement -i). This algbera is called 
the Lindenbaum-Tarski algebra of FO(A). Notice that all the Boolean algebras 
FO(A) for countable A are isomorphic, as there exists only one countable atomless 
Boolean algebra up to isomorphism (apparently proved by Tarski; see also |35j). 

For an integer p > 1, the fragment FO p (A) of FO(A) contains first-order formulas 
4> such that Fv((f>) C {x\, . . . , x p }. The fragment FOo(A) of FO(A) contains first- 
order formulas without free variables (that is sentences). 

We check that the permutation group S p on [p] acts on FO p (A) by a ■ <j) = 
4>{x a ^x)i ■ ■ ■ i x cr(p)) an d that each permutation indeed define an automorphism of 
B(FOp(X)). Similarly, the group of permutation on N with finite support acts 
on FO(A) and B(FO(A)). Note that FO (A) C • • • C FO p (A) C FO p+ i(A) C • • • C 
FO(A). Conversely, let rank((/)) = max{i : Xi £ Fv(cf>)}. Then we have a natural 
projection tt p : FO(A) — > FO p (A) defined by 

(<j> if rank(0) < p 

7T p (0) = < 

[3x p+ i 3x p+2 ■ ■ ■ 3z rank (0) (j> otherwise 

An elementary class (or axiomatizable class) C of A-structures is a class consisting 
of all A-structures satisfying a fixed consistent first-order theory Tc- Denoting by 
It c the ideal of all first-order formulas in C that are provably false from axioms 
in Tc, The Lindenbaum-Tarski algebra i3(FO(A), Tc) associated to the theory Tc 
of C is the quotient Boolean algebra #(FO(A),T c ) = B(FO(X))/X Tc . As a set, 
S(FO(A),T c ) is simply the quotient of FO(A) by logical equivalence modulo T c . 

As we consider countable languages, Tc is at most countable and it is eas- 
ily checked that S(B(FO(X) } Tc)) is homeomorphic to the compact subspace of 
S{B(FO(X)) defined as {T £ S{B(FO(X))) : T D T c }. Note that, for instance, 
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S(£(FO (A),T c )) is a clopen set of S(B(FO {\))) if and only if C is finitely ax- 
iomatizable (or a basic elementary class), that is if Tq can be chosen to be a single 
sentence. These explicit correspondences are particularly useful to our setting. 

3.3. Stone Pairing Again. We take some time to comment Definition [5j Note 
first that this definition is consistent in the sense that for every modeling A and 
for every formula € FO(A) with p free variables can be considered as a formula 
with q > p free variables with q — p unused variables, we have 

lfV(A)0)dfI(a:) = / l n ^ (A) (a;)di4(af)- 

I Ai J Ap 

It is immediate that for every formula it holds (-10, A) = 1 — (0, A) . Moreover, 
if 0i, . . . , n are formulas, then by de Moivre's formula, it holds 

n n / k 

(V^,A)^^(-i) fe+i ( yi <a^-> a ; 

i=l fc=l H<ii<"-<ifc<7l j'=l 

In particular, if 0i,...,0fc are mutually exclusive (meaning that <p{ A 0j = 0) 
then it holds 

k k 
(\/0 i ,A)=^ i ,A). 

»=1 i=l 

It follows that for every fixed modeling A, the mapping n- (0, A) is additive 
(i.e. (-,A) g ba(B(FO(A)))): 

0! A 2 =O =>■ (0! V0 2 ,A) = (0!,A) + (02, A). 

The Stone pairing is antimonotone: 

Let 0, tp <E FO(A). For every modeling A it holds 

0hV (0,G) > (VaG). 

However, even if and ^ are sentences and (0, • ) > (0>, • ) on finite A-structures, 
this does not imply in general that h tp: let 9 be a sentence with only infinite 
models and let be a sentence with only finite models. On finite A-structures it 
holds (0 V 6, ■) = (0, • ) although V 9 Y- (as witnessed by an infinite model of 
0). 

Nevertheless, inequalities between Stone pairing that are valid for finite A-structures 
will of course still hold at the limit. For instance, for 0i,02 € FOi(A), for 
C € FC>2(A), and for a, b e N define the first-order sentence B(a, b, 0i, 0a, C) ex- 
pressing that for every vertex x such that <fii(x) holds there exist at least a vertices 
y such that <j>2{y) A y) holds and that for every vertex y such that 02 (a;) holds 
there exist at most 6 vertices a; such that 0i(x) A C,{ X :V) holds. Then it is easily 
checked that for every finite A-structure A it holds 

A h B(a, b, 0i, 02, C) =>• a(0i,A) < 6(0 2 ,A). 

For example, if a finite directed graph is such that every arc connects a vertex with 
out-degree 2 to a vertex with in-degree 1, it is clear that the probability that a 
random vertex has out-degree 2 is half the probability that a random vertex has 
in-degree 1. 

Now we come to important twist and the basic of our approach. The Stone 
pairing ( • , • ) can be considered from both sides: On the right side the functions of 
type (0, • ) are a generalization of the homomorphism density functions [10 : 

t{F,G)- |G||F| 
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(these functions correspond to (</>, G) for Boolean conjunctive queries <fi and a graph 
G). Also the density function used in [6] to measure the probability that the ball of 
radius r rooted at a random vertex as a given isomorphism type may be expressed 
as a function (</>, •). We follow here, in a sense, a dual approach: from the left 
side we consider for fixed A the function ( • , A) , which is an additive function on 
£>(FO(A)) with the following properties: 

• (-,A) > and (1,A) = 1; 

• (cr • 4>, A) = (cfi, ) for every a <E S u ; 

• if Fv(0) n Fv(V0 = 0> then (<t> A ip, A) = (0, A) (-0, A). 

Thus ( • , A) is, for a given A, an operator on the class of first-order formulas. 

We now can apply Lemma [3] to derive a representation by means of a regular 
measure on a Stone space. The fine structure and interplay of additive functions, 
Boolean functions, and dual spaces can be used effectively if we consider finite A- 
structures as probability spaces as we did when we considered finite A-structures 
as a particular case of Borel models. 

Theorem 5. Let X be a signature, let B(FO(X)) be the Lindenbaum-Tarski algebra 
o/FO(A), let 5(B(FO(A))) be the associated Stone space, and let rca(5(B(FO(A)))) 
be the Banach space of the regular countably additive measure on S(B(FO(X))). 
Then: 

(1) There is a mapping from the class of X-modeling to rca(iS(jS(FO(A)))), 
which maps a modeling A to the unique regular measure ^a such that for 
every <f> £ FO(A) it holds 

(0, A) = / l K (tfdfJ,A, 

JS(B(FO(X))) 

where 1_r-(0) is the indicator function of K(if) in S(B(FO(X))). Moreover, 
this mapping is infective of finite X-structures. 

(2) A sequence (A„)„ £ n of finite X-structures is FO-convergent if and only if 
the sequence (/iA„)neN is weakly converging in rca(5(S(FO(A)))); 

(3) If (A n ) ne pj is an FO-convergent sequence of finite X-structures then the 
weak limit /i of (/iA„)neN is such that for every <f> £ FO(A) it holds 

lim(</>,A„)= / l KW dfi. 

n ^°° JS(B(FO(\))) 

Proof. The proof follows from Lemma [3j considering the additive functions ( • , A). 

Let A be a finite A-structure. As ^a allows to recover the complete theory of A 
and as A is finite, the mapping A t— > /ia is injective. □ □ 

It will be convenient to sometimes consider fragments of FO(A) to define a weaker 
notion of convergence. 

Definition 7 (AC-convergence). Let AT be a fragment of FO(A). A sequence 
(A„) nG N of finite A-structures is X -convergent if (4>,A n ) is convergent for every 

<t>e X. 

In this context, we can extend Theorem [5j 

Theorem 6. Let X be a signature, and let X be a fragment of FO(A) defining a 
Boolean algebra B(X) C B{FO(X)). Let S(B(X)) be the associated Stone space, 
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and let tcsl(S(B(X))) be the Banach space of the regular countably additive measure 
on S(B(X)). Then: 

(1) The canonical injection t x : B(X) — > i3(FO(A)) defines by duality a contin- 
uous projection p x : S(B(FO(X))) —> S(B(X)); The pushforward p x [1a of 
the measure fiA associated to a modeling A (see Theorem^ is the unique 
regular measure on S(B(X)) such that: 

(0, A) = / l K u) dp X fi A , 

JS(B(X)) 

where ^-k(4>) is the indicator function of K ((f)) in S(B(X)). 

(2) A sequence (A„)„ e pj of finite X-structures is X -convergent if and only if 
the sequence (p x MA„)neN * s wea kly converging in rca.(S(B(X))) ; 

(3) 7/(A„)„ 6 N is an X -convergent sequence of finite X-structures then the weak 
limit /i of (p^/iAjJnsN is such that for every cf> G X it holds 

lim ((f), A n ) = / I^ja) d^i. 

JS(B(X)) 



Proof. If X is closed under conjunction, disjunction and negation, thus denning a 
Boolean algebra B(X), then the inclusion of X in FO(A) translates as a canonical 
injection l from B(X) to B(FO(X)). By Stone duality, the injection l corresponds 
to a continuous projection p : S(B(FO(X))) —> S(B(X)). As every measurable 
function, this continuous projection also transports measures by pushforward: the 
projection p transfers the measure [i on 5'(6(FO(A))) to S(B(X)) as the pushfor- 
ward measure p*[i defined by the identity p*[i(Y) = fi(p~ 1 (Y)), which holds for 
every measurable subset Y of S(B(X)). 

The proof follows from Lemma [3j considering the additive functions ( • , A) . □ 

□ 

We can also consider a notion of convergence restricted to A-structures satisfying 
a fixed axiom. 

Theorem 7. Let X be a signature, and let X be a fragment of FO(A) defining a 
Boolean algebra B(X) C S(FO(A)). Let S(B(X)) be the associated Stone space, 
and let rc&(S(B(X))) be the Banach space of the regular countably additive measure 
onS(B(X)). 

Let C be a basic elementary class defined by a single axiom $£lfl FOo, and 
let Iy be the principal ideal of B(X) generated by 
Then: 

(1) The Boolean algebra obtained by taking the quotient of X equivalence 
modulo ^> is the quotient Boolean algebra B(X, 'J) = B(X)/I^. Then 
S(B(X,^>)) is homeomorphic to the clopen subspace K(^) of S(B(X)). 

If A G C is a finite X-structure then the support of the measure p x ha 
associated to A (see Theorem^ is included in K(fy) and for every <f> G X 
it holds 

(0, A) = / 1 K{4>) dp X (i A - 

(2) A sequence (A„) n£ N of finite X-structures of C is X-convergent if and only 
if the sequence (p x HA n )n&i is weakly converging in ica,(S(B(X, *&))); 

(3) If (A„)„ s n is an X-convergent sequence of finite X-structures in C then the 
weak limit /i of (p X [iA n )n&i is such that for every <f) G X it holds 

lim ((f), A n ) = / 1-KU) <bx 
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Proof. The quotient algebra B(X, <J>) = B(X)/I^ is isomorphic to the sub-Boolean 
algebra B' of B of all (equivalence classes of) formulas <f> A \& for <f> e A. To 
this isomorphism corresponds by duality the identification of S(B(X, W)) with the 
clopen subspace K(V) of S(B(X)). □ □ 

The situation expressed by these theorems is summarized in the following dia- 
gram. 

B(FQ(A)) canonical injection ^ ^ inclusion g/ ^ isomorphism ? ^ ^ 

A 



V . . x Y 

projection p ,-,/„/ v ,, inclusion 



homeomorphism 



5(B(FO(A))) " J " > tf(tt) , " " S(B(X, *)) 



pushforward „ restriction y 

We shall now examine more closely A-convergence for fragments X of FO(A) 
which are relevant to examples and limits previously studied and consider in par- 
ticular the structure of the Stone spaces S(B(X)). 

4. Convergence, Old and New 

As we have seen above, there are many ways how to say that a sequence (A„)„ £ n 
of finite A-structures is convergent. As we considered A-structures defined with a 
countable signature A, the Boolean algebra £>(FO(A)) is countable. It follows that 
the Stone space S(B(FO(X) j) is a Polish space thus (with the Borcl er-algcbra) it 
is a standard Borel space. Hence every probability distribution turns S(S(FO(A))) 
into a standard probability space. However, the fine structure of S(B(FO(A))) is 
complex and we have no simple description of this space. 

FO-convergence is of course the most restrictive notion of convergence and it 
seems (at least on the first glance) that this is perhaps too much to ask, as we may 
encounter many particular difficulties and specific cases. But we shall exhibit later 
classes for which FO-convergence is captured — for special basic elementary classes 
of structures — by A-convergence for a small fragment X of FO. 

At this time it is natural to ask whether one can consider fragments that are 
not sub-Boolean algebras of FO(£) and still have a description of the limit of a 
converging sequence as a probability measure on a nice measurable space. There is 
obviously a case where this is possible: when the convergence of ((f), A„) for every 
(j) in a fragment X implies the convergence of (tp, A„) for every ip in the minimum 
Boolean algebra containing X. We prove now that this is for instance the case 
when A is a fragment closed under conjunction. 

We shall need the following preliminary lemma: 

Lemma 4. Let X C B be closed by A and such that X generates B (i.e. such that 
B[X) = B). 

Then {lb : b e A}U{1} (where 1 is the constant function with value 1) includes 
a basis of the vector space V(B) generated by the whole set {lb : b e B}. 

Proof. Let b E B. As A generates B there exist b\,...,bk € A and a Boolean 
function F such that b = F(b\, . . . , bk). As l x ^ y = l x 1 y and l-, x = 1 — l x 
there exists a polynomial Pp such that 1& = Pp(l(, 1 , . . . , For I C [fc], the 

monomial Y\ ieI lb 4 rewrites as 1^ where bi = f\ ieI fy. It follows that lfc is a linear 
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combination of the functions 1^ (7 C [k]) which belong to X if I ^ (as X is 
closed under A operation) and equal 1, otherwise. □ □ 

Lemma 5. Let X be a fragment of FO(A) closed under (finite) conjunction - 
thus defining a meet semilattice of £?(FO(A)) — and let B(X) be the sub-Boolean 
algebra of £>(FO(A)) generated by X . Let X be the fragment o/FO(A) consisting of 
all formulas with equivalence class in B(X). 

Then X -convergence is equivalent to X -convergence. 

Proof. Let ^ e X. According to Lemma [ij there exist <f>\ , . . . , (j>k € X and 
ao, <Xi, ■ ■ ■ j o^k £R such that 

fe 

1* = a l + Qjjl^. 
»=i 

Let A be a A-structure, let SI = S(B(X)) and let € rca(f7) be the associated 
measure. Then 

/* /* Aj A, 

(*,A) = / l*d// A = / (Qol + y^Qiil^)d/iG = a +y^Oi(0j, A). 

It follows that if (A„)„ e pj is an X-convergent sequence, the sequence ((ip, A n )) nG N 
converges for every ip £ X, that is (A„) ne jj is -convergent. □ □ 

We now will demonstrate the expressive power of X-convergence by relating it 
to the main types of convergence of graphs studied previously: 

(1) the notion of dense graph limit [9l 146] : 

(2) the notion of bounded degree graph limit [HUE]; 

(3) the notion of elementary limit derived from two important results in first- 
order logic, namely Godel's completeness theorem and the compactness 
theorem. 

These standard notions of graph limits, which have inspired this work, corre- 
spond to special fragments of FO(A), where 7 is the signature of graphs. In the 
remaining of this section, we shall only consider undirected graphs, thus we shall 
omit to precise their signature in the notations as well as the axiom defining the 
basic elementary class of undirected graphs. 

4.1. L-convergence and QF-convergence. Recall that a sequence (G„)„ e N of 
graphs is L-convergent if 

hom(F,G„) 
[ ' n, ~ |G n pl 

converges for every fixed (connected) graph F, where hom(i 7 ', G) denotes the number 
of homomorphisms of F to G [IBI [TT\ IT2] . 

It is a classical observation that homomorphisms between finite structures can be 
expressed by Boolean conjunctive queries [14]. We denote by HOM the fragment 
of FO consisting of formulas formed by conjunction of atoms. For instance, the 
formula 

(xi ~ x 2 ) A (x 2 ~ x 3 ) A (x 3 — xi) A (xi ~ x 5 ) A (x 5 ~ xi) 

belongs to HOM and it expresses that (xi, x 2 , £3, £4, 25) form a homomorphic image 
of C5. Generally, to a finite graph F we associate the canonical formula ^ e HOM 
defined by 

(f) F := f\ (xi ~ xj). 

ijeE(F) 

Then, for every graph G it holds 
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Wf, G) = [F] — = t(F, G). 

Thus L-convergence is equivalent to HOM-convergence. According to Lemma [5j 
HOM-convergence is equivalent to HOM-convergent. It is easy to see that HOM is 
the fragment QF - of quantifier free formulas that do not use equality. We prove 
now that HOM-convergence is actually equivalent to QF-convergence, where QF is 
the fragment of all quantifier free formulas. Note that QF is a proper fragment of 

-pQlocal 



Theorem 8. Let (G n ) be a sequence of finite graphs such that linin^oo \G n \ = oo. 
Then the following conditions are equivalent: 

(1) the sequence (G n ) is L-convergent; 

(2) the sequence (G n ) is QF - -convergent; 

(3) the sequence (G n ) is QF -convergent; 



Proof. As L-convergence is equivalent to HOM-convergence and as HOM C QF~ C 
QF, it is sufficient to prove that L-convergence implies QF-convergence. 

Assume (G n ) is L-convergent. The inclusion-exclusion principle implies that for 
every finite graph F the density of induced subgraphs isomorphic to F converges 
too. Define 



dens(F, G n ) - 



\G n \\ F \ ■ 

Then dens(F, G n ) is a converging sequence for each F. 

Let 9 be a quantifier-free formula with Fv(#) C [p\. We first consider all possible 
cases of equalities between the free variables. For a partition V = (It,.. . , Ik) of 
[p], we define \V\ = k and s-p(i) — min/i (for 1 < i < \V\). Consider the formula 

\v\ , \v\ . 

& := A ( A ( x i = ^w) A A i x 'v(j) ^ x s-p(i))) ■ 

i=l ^jeh j=i+l 
Then 6 is logically equivalent to 

{/\{xi + Xj) AO) V \J ( v A6 v {x sv(1) ,...,x svm) ). 

ijtj V:\V\<p 

Note that all the formulas in the disjunction are mutually exclusive. Also 
f\ i7 tj(xi 7^ xj) A 6 may be expressed as a disjunction of mutually exclusive terms: 



f\( Xi ^x j )Ae= V e' F , 

where J 7 is a finite family of finite graphs F and where G \= 9' F (vi, . . . , v p ) if and 
only if the mapping i i— > Vi is an isomorphism from F to G[«i, . . . , v p ]. 
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It follows that for every graph G it holds: 

FeJF V:\V\<p 

Fer v-.\v\<p 

V- 1 K(«i.---.«p) : G\=0' F (v r7{1) ,...,v aip) )}\ nnn ,_u 

FGF^ <re6„ 1 1 



E Aut | F) dens(f,G) + 0(|Gr 1 ; 



Thus (8,G n ) converge for every quantifier-free formula 9. Hence (G n ) is QF- 
convergent. □ □ 

Notice that the condition that linin^oo \G n \ is necessary as witnessed by the 
sequence (G n ) where G n is K\ if n is odd and 2K\ if n is even. The sequence 
is obviously L-convergent, but not QF convergent as witnessed by the formula 
4>{x 1 y) : x y, which has density in K\ and 1/2 in K2. 

Remark 2. The Stone space of the fragment QF~ has a simple description. Indeed, 
a homomorphism h : B(QF~) — > 2 is determined by its values on the formulas 
Xi ~ Xj and any mapping from this subset of formulas to 2 extends (in a unique 
way) to a homomorphism of £>(QF~) to 2. Thus the points of 5(£>(QF~)) can be 
identified with the mappings from (^) to {0, 1} that is to the graphs on N. Hence 
the considered measures p are probability measures of graphs on N that have the 
property that they are invariant under the natural action of S u on N. Such random 
graphs on N are called infinite exchangeable random graphs. For more on infinite 
exchangeable random graphs and graph limits, see e.g. [H 116] . 

4.2. BS-convergence and F0 local -convergence. The class of graphs with max- 
imum degree at most D (for some integer D) received much attention. Specifically, 
the notion of local weak convergence of bounded degree graphs was introduced in 
[B], which is called here BS-convergence: 

A rooted graph is a pair (G, o), where o £E V(G). An isomorphism of rooted 
graph (j) : (G, o) — > (G',o') is an isomorphism of the underlying graphs which 
satisfies <fi(o) = d . Let D € N. Let Qp denote the collection of all isomorphism 
classes of connected rooted graphs with maximal degree at most D. For the sake of 
simplicity, we denote elements of Gd simply as graphs. For (G, o) £ Gd and r > 
let Bc(o,r) denote the subgraph of G spanned by the vertices at distance at most 
r from o. If (G, o), (G', o') e Gd and r is the largest integer such that (Ba(o, r),o) 
is rooted-graph isomorphic to (Be (o' , r), o'), then set p((G, o), (G',o')) = 1/r, say. 
Also take p((G,o), (G,o)) = 0. Then p is metric on Gd- Let DJId denote the space 
of all probability measures on Gd that are measurable with respect to the Borcl 
cr-field of p. Then SH^ is endowed with the topology of weak convergence, and is 
compact in this topology. 

A sequence (G n ) raS N of finite connected graphs with maximum degree at most 
D is BS- convergent if, for every integer r and every rooted connected graph (F, o) 
with maximum degree at most D the following limit exists: 

Um \{v:B Gn (v,r)^(F,o)}\ ^ 
n-yoo \G n \ 
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This notion of limits leads to the definition of a limit object as a probability 
measure on Qd [6]. 

To relate BS-convergence to X-convergence, we shall consider the fragment of 
local formulas: 

Let r G N. A formula G FO p is r -local if, for every graph G and every 
v\ , . . . , v p € G p it holds 

G\=<f)(vx,...,v p ) <*=4> G[N r (vi,...,v p )]\=<j>(v 1 ,...,Vp), 

where G[N r (vi, . . . ,v p )] denotes the subgraph of G induced by all the vertices at 
(graph) distance at most r from one of V\, . . . , v p in G. 

A formula is local if it is r-local for some r G N; the fragment F0 local is the 
set of all local formulas in FO. Notice that if 0i and 02 are local formulas, so are 
01 A 02, 0i V 02 and ->0i. It follows that the quotient of F0 local by the relation of 
logical equivalence defines a sub-Boolean algebra S(F0 local ) of B(FO). For p e N 
we further define F0p Ocal = F0 local n FO p . 

Theorem 9. Let (G n ) be a sequence of finite graphs with maximum degree d, with 
linin^oo \G n \ =oo. 

Then the following properties are equivalent: 

(1) the sequence (G„)„ e N is BS- convergent; 

(2) the sequence (G n )neN is FO] 003, -convergent; 

(3) the sequence (G„)„ e N is FO oca -convergent. 

Proof. If (G„) neN is F0 local -convergent, it is FO^'-convergcnt; 

If (G n ) n eN is F0 1 1 ocal -convergent then it is BS-convergent as for any finite rooted 
graph (F, o) , testing whether the the ball of radius r centered at a vertex x is 
isomorphic to (F, o) can be formulated by a local first order formula. 

Assume (G n )„gN is BS-convergent. As we consider graphs with maximum de- 
gree d, there are only finitely many isomorphism types for the balls of radius r 
centered at a vertex. It follows that any local formula £(x) with a single vari- 
able can be expressed as the conjunction of a finite number of (mutually exclusive) 
formulas &p t0 \(x), which in turn correspond to subgraph testing. It follows that 
BS-convergence implies F0 1 1 ocal -convergence. 

Assume (G„) nS N is FOi° cal -convergent and let € F0p Ocal be an r-local formula. 
Let be the set of all p-tuples ((i*i, /i), ■ • ■ , (F p , f p )) of rooted connected graphs 
with maximum degree at most d and radius (from the root) at most r such that 

\Ji Fi h0(/i,.--,/ P ). 

Then, for every graph G the sets 

^4>( G ) = ■ ■ ■ > w p) : G 1= <K u i> ■ • • , v p)} 

and 

|+J f[{v: G\=6 [FtJt) (v)} 

((F 1 ,/i),...,(F p ,/ p ))e^i=l 

differ by at most 0(|G| P_1 ) elements. Indeed, according to the definition of an 
r-local formula, the p-tuples (x±, . . . , x p ) belonging to exactly one of these sets are 
such that there exists 1 < i < j < p such that dist(xi,Xj) < 2r. 
It follows that 

(<t>,G) = { E flie^j^G^ + odcr 1 ). 

((F,J.))k.< p 6^ i=l 
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It follows that F0 1 1 ocal -convergence (hence BS-convergence) implies full F0 local - 
convergence. □ □ 

Remark 3. According to this proposition and Theorem[7J the BS-limit of a sequence 
of graphs with maximum degree at most D corresponds to a probability measure 
on S(B(FO° )) whose support is include in the clopen set K((d), where Cd is 
the sentence expressing that the maximum degree is at most D. The Boolean 
algebra B(FO l ° cal ) is isomorphic to the Boolean algebra defined by the fragment 
X C FO (Ai) of sentences for rooted graphs that are local with respect to the root 
(here, Ai denotes the signature of graphs augmented by one symbol of constant). 
According to this locality, any two countable rooted graphs (Gi,n) and (G 2 ,r 2 ), 
the trace of the complete theories of (Gi, ri) and (G2, r 2 ) on X are the same if and 
only if the (rooted) connected component (G' 1; ri) of (Gi,ri) containing the root n 
is elementary equivalent to the (rooted) connected component (G 2 ,r 2 ) of (G 2 ,r 2 ) 
containing the root r 2 . As isomorphism and elementary equivalence are equivalent 
for countable connected graphs with bounded degrees (see Lemma [6]) it is easily 
checked that Kx{Cd) is homeomorphic to Qn- Hence our setting (while based on 
a very different and dual approach) leads essentially to the same limit object as [6] 
for BS-convergent sequences. 

4.3. Elementary-convergence and FOo-convergence. We already mentioned 
that FOo-convergence is nothing but elementary convergence. Elementary conver- 
gence is implicitly part of the classical model theory. Although we only consider 
graphs here, the definition and results indeed generalize to general A-structures We 
now reword the notion of elementary convergence: 

A sequence (G„)„ e N is elementarily convergent if, for every sentence </> € FOo, 
there exists a integer N such that either all the graphs G n (n > N) satisfy (j> or 
none of them do. 

Of course, the limit object (as a graph) is not unique in general and formally, 
the limit of an elementarily convergent sequence of graphs is an elementary class 
defined by a complete theory. 

Elementary convergence is also the backbone of all the X-convergences we con- 
sider in this paper. The FOo-convergence is induced by an easy ultrametric defined 
on equivalence classes of elementarily equivalent graphs. Precisely, two (finite or 
infinite) graphs G\ 1 G 2 are elementarily equivalent (denoted G\ = G 2 ) if, for every 
sentence <j) it holds 



G l h G 2 \= <j>. 

In other words, two graphs are elementarily equivalent if they satisfy the same 
sentences. 

A weaker (parametrized) notion of equivalence will be crucial: two graphs G\ , G 2 
are k- elementarily equivalent (denoted G\ = k G 2 ) if, for every sentence <f> with 
quantifier rank at most k it holds G\ |= 4> •<=>■ G2 |= 4>. 

It is easily checked that for every two graphs Gi, G2 it holds: 

Gi = G 2 ^ (Vfc e N) d = k G 2 . 

For every fixed k G N, checking whether two graphs G\ and G2 are fc-elementarily 
equivalent can be done using the so-called Ehrcnfcucht-Fra'isse game. 

From the notion of fc-elementary equivalence naturally derives a pseudometric 
dist (Gi,G 2 ): 



dist (Gi,G 2 ) = 



if Gi = G 2 

v min{2-v ank W) : (Gi |= <f) A (G 2 |= -•<£)} otherwise 
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Proposition 1. The metric space of countable graphs (up to elementary equiva- 
lence) with ultrametric disto is compact. 

Proof. This is a direct consequence of the compactness theorem for first-order logic 
(a theory has a model if and only if every finite subset of it has a model) and of the 
downward Lowenheim-Skolem theorem (if a theory has a model and the language 
is countable then the theory has a countable model). □ □ 

Note that not every countable graph is (up to elementary equivalence) the limit 
of a sequence of finite graphs. A graph G that is a limit of a sequence finite graphs 
is said to have the finite model property, as such a graph is characterized by the 
property that every finite set of sentences satisfied by G has a finite model (what 
does not imply that G is elementarily equivalent to a finite graph). 

Example 1. A ray is not an elementary limit of finite graphs as it contains exactly 
one vertex of degree 1 and all the other vertices have degree 2, what can be expressed 
in first-order logic but is satisfied by no finite graph. However, the union of two 
rays is an elementary limit from the sequence (P n )neN of paths of order n. 

Although two finite graphs are elementary equivalent if and only if they are iso- 
morphic, this property does not holds in general for countable graphs. For instance, 
the union of a ray and a line is elementarily equivalent to a ray. However we shall 
make use of the equivalence of isomorphisms and elementary equivalences for rooted 
connected countable locally finite graphs, which we prove now for completeness. 

Lemma 6. Let (G,r) and (G',r') be two rooted connected countable graphs. 

If G is locally finite then (G,r) = (G',r') if and only if (G,r) and (G',r r ) are 
isomorphic. 

Proof. If two rooted graphs are isomorphic they are obviously elementarily equiv- 
alent. Assume that (G,r) and (G',r') are elementarily equivalent. Enumerate the 
vertices of G in a way that distance to the root is not decreasing. Using n-back- 
and- forth equivalence (for all n€N), one builds a tree of partial isomorphisms of 
the subgraphs induced by the n first vertices, where ancestor relation is restric- 
tion. This tree is infinite and has only finite degrees. Hence, by Konig's lemma, it 
contains an infinite path. It is easily checked that it defines an isomorphism from 
(G,r) to (G',r') as these graphs are connected. □ □ 

Fragments of FOo allow to define convergence notions, which are weaker that 
elementary convergence. The hierarchy of the convergence schemes defined by sub- 
algebras of B(FO ) is as strict as one could expect. Precisely, if A C Y are two 
sub-algebras of B(FO ) then F-convergence is strictly stronger than A-convergence 
- meaning that there exists graph sequences that are A-convergent but not Y - 
convergent — if and only if there exists a sentence <f> £ Y such that for every 
sentence tp £ X, there exists a (finite) graph G disproving </> <-> tp. 

We shall see that the special case of elementary convergent sequences is of partic- 
ular importance. Indeed, every limit measure is a Dirac measure concentrated on a 
single point of S(B(FOo))- This point is the complete theory of the elementary limit 
of the considered sequence. This limit can be represented by a finite or countable 
graph. As FO-convergence (and any FO p -convergence) implies FOo-convergence, 
the support of a limit measure /i corresponding to an FO p -convergent sequence (or 
to an FO-convergent sequence) is such that Supp(^i) projects to a single point of 
S(B(FO )). 

Finally, let us remark that all the results of this section can be readily formulated 
and proved for A-structures. 
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5. Combining Fragments 

5.1. The FO p Hierarchy. When we consider FOp-convergence of finite A-structures 
for finite a signature A, the space S(B(FO p (\))) can be given the following ul- 
tramctric dist p (compatible with the topology of S(B(FO p (X)))): Let Ti,T 2 E 
S(B(FO p {\))) (where the points of S(B(FO p (\))) arc identified with ultrafilters 
on B(FO p (A))). Then 



dist p (Ti,T 2 ) = 



'0 if T 1= T 2 

2-min{qrank(0): 0eTi\T 2 } otherwise 

This ultrametric has several other nice properties: 

• actions of S p on S(B(FO p (X))) are isometries: 

Vct g S p VT l5 T 2 e S(B(FO p (X))) distp(a ■ T u a ■ T 2 ) = distp(T 1; T 2 ); 

• projections ir p are contractions: 

Vq > P VT l5 T 2 e S(B(FO g (X))) dist p (7r p (T 1 ), 7r p (T 2 )) < dist 9 (T l7 T 2 ); 

We prove that there is a natural isometric embedding r\ p : S(B(FO p (X)j) — > 
5(B(FO(A))). This may be seen as follows: for an ultrafilter X e 5(B(FO p (A))), 
consider the filter JT + on B(FO(A)) generated by X and all the formulas Xi — x i+ i 
(for i > p). This filter is an ultrafilter: for every sentence <j> € FO(A), let <fi be 
the sentence obtained from <fi by replacing each free occurrence of a variable x q 
with q > p by x p . It is clear that <f) an d <p are equivalent modulo the theory 
T p = {{xi = x i+ i) : i > p}. As cither <j> or ^<j> belongs to X, either <j> or -i</> belongs 
to i] p (X). Moreover, we deduce easily from the fact that <f> and <f> have the same 
quantifier rank that if q > p then 7r q o r\ v is an isometry. Finally, let us note that 
7Tp o rjp is the identity of S(B(FO p (X))). 

Let Ap be the signature A augmented by p symbols of constants ci, . . . , c p . There 
is a natural isomorphism of Boolean algebras v p : FO p (A) — > FOo(Ap), which re- 
places the free occurrences of the variables x\, . . . , x p in a formula <fi <G FO p by the 
corresponding symbols of constants c\, . . . ,c p , so that it holds, for every modeling 
A, for every <fi e FO p and every V\, . . . , v p £ A: 

A\=<j)(v 1 ,...,v p ) <=^> (K,v 1 ,...,v p )\=v p {4>). 

This mapping induces an isometric isomorphism of the metric spaces (S(B(FO p (X))), distp) 
and (S(B(FOo(A p ))),disto). Note that the Stone space 5(£>(FO (Ap))) associated 
to the Boolean algebra B(FOo(X p )) is the space of all complete theories of A p - 
structures. In particular, points of S(B(FO p (X)) can be represented (up to ele- 
mentary equivalence) by countable A-structures with p special points. All these 
transformations may seem routine but they need to be carefully formulated and 
checked. 

We can test whether the distance distp of two theories T and T" is smaller than 
2~™ by means of an Ehrcnfcucht-Fra'isse game: Let v p (T) = {v p {4>) : <fi E T} and, 
similarly, let v p {T') = {^ p (^) : 4> € T'}. Let (A, V\, . . . , v p ) be a model of T and let 
(A', v[, . . . , v'p) ba a model of T'. Then it holds 

dist p (T,T')<2-" (A,v u ...,v p )= n (A',v' 1 ,...,v' p ). 

Recall that the n-rounds Ehrenfeucht-Fraisse game on two A-structures A and 
A', denoted EF(A, A', n) is the perfect information game with two players — the 
Spoiler and the Duplicator — defined as follows: The game has n rounds and each 
round has two parts. At each round, the Spoiler first chooses one of A and A' and 
accordingly selects either a vertex x e A or a vertex y e A'. Then, the Duplicator 
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selects a vertex in the other A-structure. At the end of the n rounds, n vertices have 
been selected from each structure: x\, . . . ,x n in A and y\, . . . ,y n in A' {xi and j/j 
corresponding to vertices x and y selected during the ith round). The Duplicator 
wins if the substructure induced by the selected vertices are order-isomorphic (i.e. 
Xi n- yi is an isomorphism of A[{xi, . . . , x n }] and A'[{yi, . . . , y n }})- As there are 
no hidden moves and no draws, one of the two players has a winning strategy, and 
we say that that player wins EF(A, A', n). The main property of this game is the 
following equivalence, due to Fraisse [22 [28] and Ehrenfeucht [22] : The duplicator 
wins EF(A, A',n) if and only if A =" A'. In our context this translates to the 
following equivalence: 

dist p (r,T') < 2~ n ^> Duplicator wins EF((A,i>i, . . .,v p ), (A',v' 1 ,.. .,v' p ),n). 

As FO C FOi C • • • C FO p C FOp+i c • • • C FO = \J Z FO,, the fragments FO 
form a hierarchy of more and more restrictive notions of convergence. In particular, 
FOp+i -convergence implies FO p -convergence and FO-convergence is equivalent to 
FO p for all p. If a sequence (A rl ) nS N is FO p -convergent then for every q < p the 
FO g -limit of (A„)„ e pj is a measure fi q € rca(5(S(F0 9 ))), which is the pushforward 
of fi p by the projection ir q (more precisely, by the restriction of 7r g to S(B(FO, p ))): 

5.2. F0 local and Locality. FO -convergence can be reduced to the conjunction of 
elementary convergence and F0 local -convergence, which we call local convergence. 
This is a consequence of Gaifman locality theorem, which we recall now. 

Theorem 10 (Gaifman locality theorem [30) ) ■ For every first-order formula <t>(x\, . . . 
there exist integers t and r such that <f> is equivalent to a Boolean combination of 
t-local formulas S, s (xi 1 , . . . ,X{ a ) and sentences of the form 

(3) 3 yi ...3y m ( /\ dist( W ,ift) >2rA /\ ^( W )J 

l<i<j<m l<i<m 

where ip is r-local. Furthermore, we can choose 

r < 7<v™ k W-\ t < (7«i»nkW)-i - l)/2, m < n + qrank(0), 

and, if (j) is a sentence, only sentences ^ occur in the Boolean combination. More- 
over, these sentences can be chosen with quantifier rank at most g(qrank(0)), for 
some fixed function q. 

From this theorem and the following folklore technical result will follow the 
claimed decomposition of FO-convergence into elementary and local convergence. 

Lemma 7. Let B be a Boolean algebra, let A\ and A2 be sub-Boolean algebras of 
B, and let b 6 B[A\ U A%] be a Boolean combination of elements from A\ and Ai- 
Then b can be written as 

b =\f Xi Ay u 

iei 

where I is finite, Xi € A\, yi € A<i, and for every i ^ j in I it holds (xi A yi) A (xj A 

Vj) = 0. 

Proof. Let b = F(u±, . . . , u a , v\, . . . , Vb) with Ui G A\ (1 < i < a) and vj e A2 
(1 < j < b) where F is a Boolean combination. By using iteratively Shannon's 
expansion, we can write F as 

F(u 1 ,...,u a ,v i ,...,v b )= \f ( f\ Ui A f\ -*Ui A /\ vj A f\ ->Vj), 

(x u x 2: Y 1 ,Y2)eJ r iex 2 jeYt jeY 2 
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where J 7 is a subset of the quadruples (Xi, X2, ii, I2) such that (Xi, X2) is a par- 
tition of [a] and (Yi, Y2) is a partition of [b]. For a quadruple Q — (Xi, X 2 , Y\, Y 2 ), 

define x Q = A ieXl u i A Azex 2 ^ and VQ = A ] eY 1 v i A Ajer 2 ^ v r Then for 
every Q £ T it holds G Ai, j/q € ^2, for every Q 7^ Q' e J 7 it holds 
A yg A x Q > A t/ Q < = 0, and we have 6 = Vq £ .f A 2/Q- 1=1 1=1 



Theorem 11. Let (A n ) be a sequence of finite X-structures. Then (A„) is FO- 
convergent if and only if it is both pQ local _ convergent and FOo-convergent. Pre- 
cisely, (A„) is FOp-convergent if and only if it is both FOp° ca -convergent and FOo- 
convergent. 



Proof. Assume (A„)„ £ n is both FOp° cal -convergent and FOo-convergent and let 4> G 



FO p . According to Theorem 10 there exist integers t and r such that <f> is equivalent 
to a Boolean combination of t- local formula £(2;^ , . . . , Xi s ) and of sentences. As both 
pQiocai an j yq q define a sub-Boolean algebra of B(FO), according to Lemma [TJ 
cj> can be written as ViG/V'i A #i> where / is finite, ip t € FO local , 6i € FO , and 
tpi A 0i A ?/>j A 6>j ; = if i 7^ j. Thus for every finite A-structure A it holds 

(^A)=^(^A^,A). 

As (• , A) is additive and (0j,A) G {0,1} we have (tp l A 0j,A) = (tpi, A) (0;, A). 
Hence 



i,A)=J><,A) (^,A) 



Thus if (A„)„ eN is both FOp° cal -convergent and FO -convergent then (A„)„ eN is 
FOp-convergent. □ □ 

Similarly that points of S(B(FO p (X)) can be represented (up to elementary equiv- 
alence) by countable A-structures with p special points, points of S'(S(FO p ocal (A)) 
can be represented by countable A-structures with p special points such that every 
connected component contains at least one special point. In particular, points of 
5(6(F0i ocal (A)) can be represented by rooted connected countable A-structures. 

Also, the structure of an F0 2 ocal -limit of graphs can be outlined by considering 
that points of S(B(F0 2 ocld )) as countable graphs with two special vertices c\ and c 2 , 
such that every connected component contains at least one of c\ and c 2 . Let /j, 2 be 
the limit probability measure on ^(^(FO^ 1 )) for an F0 2 ocal -convergent sequence 
(G„)„ eN , let 7Ti be the standard projection of S^FO 1 ^ 1 )) into ^(FO^ 1 )), 
and let [i\ be the pushforward of [i 2 by 7Ti . We construct a measurable graph G as 
follows: the vertex set of G is the support Supp(/zi) of Two vertices x and y 
of G are adjacent if there exists x' G tt^ (x) and y' G 7rf 1 (2/) such that (considered 
as ultrafilters of £(F0 2 oca1 )) it holds: 

• x\ ~ x 2 belongs to both x' and y' , 

• the transposition n,2 exchanges x' and y' (i.e. y' — T\ t 2 ■ x'). 

The vertex set of G is of course endowed with a structure of a probability space 
(as a measurable subspace of S(B(FO l ° cal )) equipped with the probability measure 
^1). In the case of bounded degree graphs, the obtained graph G is the graph of 
graphs introduced in [33]. Notice that this graph may have loops. An example of 
such a graph is shown Fig. [I] 
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Figure 1. An outline of the local limit of a sequence of trees 



5.3. Sequences with Homogeneous Elementary Limit. Elementary conver- 
gence is an important aspect of FO-convergence and we shall see that in several 
contexts, FO-convergence can be reduced to the conjunction and elementary con- 
vergence of X-convergence (for some suitable fragment X). 

In some special cases, the limit (as a countable structure) will be unique. This 
means that some particular complete theories have exactly one countable model (up 
to isomorphism). Such complete theories are called u> -categorical. Several properties 
are known to be equivalent to w-categoricity. For instance, for a complete theory 
T the following statements are equivalent: 

• T is w-categorical; 

• for every every p €N, the Stone space S(B(FO p (\), T)) is finite (see Fig.[2|; 

• every countable model A of T has an oligomorphic automorphism group, 
what means that for every n G N, A n has finitely many orbits under the 
action of Aut(A). 

A theory T is said to have quantifier elimination if, for every formula <j) € FO p (A) 
there exists <fr & QF p (A) such that T \= 4> -H- (f>. If a theory has quantifier elimination 
then it is w-categorical. Indeed, for every p, there exists only finitely many quantifier 
free formulas with p free variables hence (up to equivalence modulo T) only finitely 
many formulas with p free variables. The unique countable model of a complete 
theory T with quantifier elimination is ultra-homogeneous, what means that every 
partial isomorphism of finite induced substructures extends as a full automorphism. 
In the context of relational structures, the property of having a countable ultra- 
homogeneous model is equivalent to the property of having quantifier elimination. 
We provide a proof of this folklore result (in the context of graphs) in order to 
illustrate these notions. 
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Figure 2. Ultrafilters projecting to an w-categorical theory 




Lemma 8. Let T be a complete theory (of graphs) with no finite model. 

Then T has quantifier elimination if and only if some (equivalently, every) count- 
able model of T is ultra-homogeneous. 

Proof. Assume that T has an ultra- homogeneous countable model G. Let (at, . . . , a p ), 
(pi, ... , bp) be p-tuples of vertices of G. Assume that H ► b^ is an isomorphism 
between G[a\, . . . ,a p ] and G[b±, . . . , b p \. Then, as G is ultra-homogeneous, there 
exists an automorphism f of G such that /(a.;) = b t for every 1 < i < p. As the 
satisfaction of a first-order formula is invariant by the action of the automorphism 
group, for every formula <p € FO p it holds 

G\=(j)(ai,...,ap) <*=S> G\=(j)(bx,...,b p ). 

Consider a maximal set T of p-tuples (y±, . . . , v p ) of G such that G \= 4>(vi, . . . , u p ) 
and no two p-tuples induce isomorphic (ordered) induced subgraphs. Obviously 
|j7| = 2°(p ) is finite. Moreover, each p-tuple v — (v\, . . . ,v p ) defines a quantifier 
free formula r\$ with p free variables such that G \= rjjj(x\, . . . ,x p ) if and only if 
Xi i — ^ Vj is an isomorphism between G[x\, . . . , x p ] and G[ui, . . . , v p \. Hence it holds: 

G h <t> <-> V 

In other words, is equivalent (modulo T) to the quantifier free formula <f> — 
rjff, that is: T has quantifier elimination. 
Conversely, assume that T has quantifier elimination. As notice above, T is uj- 
categorical thus has a unique countable model. Assume {at,..., a p ) and (b\, . . . , b p ) 
are p-tuples of vertices such that / : <Zj i-> fcj is a partial isomorphism. Assume 
that / does not extend into an automorphism of G. Let (at, ■ ■ ■ , a g ) be a tuple 
of vertices of G of maximal length such that there exists b p+ t, . . . ,b q such that 
at i y b% is a partial isomorphism. Let a ? +i be a vertex distinct from a\, . . . ,a q . Let 
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As T has quantifier elimination, there exists a quantifier free formula <p such that 
T \= (f> 4*. As G |= </>(ai, . . . , a q ) (witnessed by a g+1 ) it holds G |= 0(ai , . . . , a q ) 
hence G (= cf>(bi, . . . ,b q ) (as a, i— )■ 6;, 1 < i < q is a partial isomorphism) thus 
G \= 4>(bi, . .. ,bg). It follows that there exists b q+ i such that i-^ bi, 1 < i < 9 + 1 
is a partial isomorphism, contradicting the maximality of (oi, . . . , Oq). □ □ 

When a sequence of graphs is elementarily convergent to an ultra-homogeneous 
graph (i.e. to a complete theory with quantifier elimination), we shall prove that 
FO-convergence reduces to QF-convergence. This later mode of convergence is of 
particular interest as it is equivalent to L-convergence, as we first prove. 

We now prove that for sequences of graphs elementarily convergent to ultra- 
homogeneous graphs, the properties of FO-convergence and QF-convergence are 
equivalent. 

Lemma 9. Let (G n ) rag N be sequence of graphs that converges elementarily to some 
ultra-homogeneous graph G. Then the following properties are equivalent: 

• the sequence (G„)„ e N is FO -convergent; 

• the sequence (G n )„ S N is QF '-convergent. 

• the sequence (G„)„ s n is L-convergent. 

Proof. As FO-convergence implies QF-convergence we only have to prove the oppo- 
site direction. Assume that the sequence (G„) ne N is QF-convergent. According to 
Lemma [8j for every formula <j) G FO p there exists a quantifier free formula 4> G QF p 

such that G |= <f> O 4> (i.e. Th(G) has quantifier elimination). As G is an elemen- 
tary limit of the sequence (G n ) ne $j there exists N such that for every n > N it 
holds G n \= (f) f-> 4>. It follows that for every n > N it holds (<j>, G n ) — (<j>, G n ) hence 
lim„_ > . 00 (</), G n ) exists. Thus the sequence (G n ) n£ N is FO-convergent. □ □ 

There are not so many countable ultra-homogeneous graphs. 

Theorem 12 (Lachlan and Woodrow |40j). Every infinite countable ultrahomoge- 
neous undirected graph is isomorphic to one of the following: 

• the disjoint union of m complete graphs of size n, where m,n < u> and at 
least one of m or n is uj, (or the complement of it); 

• the generic graph for the class of all countable graphs not containing K n 
for a given n > 3 (or the complement of it). 

• the Rado graph R (the generic graph for the class of all countable graphs). 

Among them, the Rado graph R is characterized by the extension property: for 
every finite disjoint subsets of vertices A and B of R there exists a vertex z of 
R — A — B such that z is adjacent to every vertex in A and to no vertex in B. The 
Rado graph R will be of great importance for us, because of the following property. 

Lemma 10 (Edros, Renyi [55]). Let < 5 < 1, let pij e [5, 1 — S] for i,j 6 N and 
let G be the random countable graph with vertex set N that is such that — denoting 
Eij the event that i is adjacent to j — the events Eij are independent and the 
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probability of Eij is Pij . Then, with probability one G has the extension property 
(hence is isomorphic to the Rado graph). 

In particular, for Q < p < 1, let G n be a random graph with n vertices where 
two vertices are adjacent with probability p, independently for each pair of ver- 
tices. Then with probability 1 the resulting graph sequence (G n )neN w iH converge 
elementarily to the Rado graph. 

We now related more precisely the extension property with quantifier elimina- 
tion. 

Definition 8. Let k G N. A graph G has the k-extension property if, for every 
disjoint subsets of vertices A, B of G with size k there exists a vertex z not in AU B 
that is adjacent to every vertex in A and to no vertex in B. In other words, G has 
the fc-extension property if G satisfies the sentence below: 




2k k 2k 

-> (3z) f\ -.fa = z) A /\ (xi ~ z) A f\ ^(xi~z)j 

i=l i=l i=k+l ' 

Lemma 11. Let G be a graph and let p, r be integers. 

If G has the (p + r) -extension property then every formula <f> with p free variables 
and quantifier rank r is equivalent, in G, with a quantifier free formula. 

Proof. Let <f> be a formula with p free variables and quantifier rank r . Let (ai, . . . , a p ) 
and (pi,... ,b p ) be two p-tuples of vertices of G such that a% i— > is a partial 
isomorphism. The (p + r)-extension properties allows to easily play a r-turns 
back-and- forth game between (G, a\, ... , a p ) and (G, 6 1; . . . , 6 p ), thus proving that 
(G, ai, . . . , a p ) and (G, bi,...,b p ) are r-equivalent. It follows that G (= </>(ai, . . . , a p ) 
if and only if G |= ^>(6i, . . . , bp). Following the lines of Lemma [8j we deduce that 
there exists a quantifier free formula <f> such that G |= <j> 4-> 0. □ □ 

Lemma 12. ie< 1/2 > <5 > 0. Assume that for every positive integer n > 2 and 
every 1 < i < j < n, p n .i,j € [<5, 1 — 5]. Assume that for each n 6 N. G„ is 
a random graph on [f(n)] where f(n) > n, and where i and j are adjacent with 
probability p n ,i.j (M these events being independent). Then the sequence (G„)„ e N 
almost surely converges elementarily to the Rado graph. 

Proof. Let p £ N and let a — 8(1 — S). The probability that G n \= T p is at least 
1 - (1 - a p ) }{n) . It follows that for N G N the probability that all the graphs G„ 
(n > N) satisfy T p is at least 1 — a~ p (l — a p )^ N \ According to Borel-Cantelli 
lemma, the probability that G n does not satisfy T p infinitely many is zero. As this 
holds for every integer p, it follows that, with high probability, every elementarily 
converging subsequence of (G„) ne n converges to the Rado graph hence, with high 
probability, (G„) n6 N converges elementarily to the Rado graph. □ □ 

Thus we get: 

Theorem 13. Let < p < 1 and let G n £ G(n,p) be independent random graphs 
with edge probability p. Then (G n )nen * s almost surely FO- convergent. 



Proof. This is an immediate consequence of Lemma [9j Lemma 12 and the easy fact 
that (G„)„ e N is almost surely QF- convergent. □ □ 
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Theorem 14. For every <f> £ FO p there exists a •polynomial S 1\Xx, . . . ,Xr P \] 

such that for every sequence (Gn)neN of finite graphs that converges elementarily 
to the Rado graph the following holds: 

If (G n )„eN is L-convergent to some graphon W then 

lim (4>,G n ) =/•••/ P<f,((W i ,j(x i ,Xj))i< i< j<p)dx-L...dXp. 



Proof. Assume the sequence (G n )„ e N is elementarily convergent to the Rado graph 
and that it is L-convergent to some graphon W. 

According to Lemma [8j there exists a quantifier free formula <j) such that 

G |= (Vxi ...x p ) (f>(xi , . . . , Xp) <H> <f)(xi , . . . , x p ) 

(hence fl^,(G) — Hr(G)) holds when G is the Rado graph. As (G„)„ s n is elemen- 
tarily convergent to the Rado graph, this sentence holds for all but finitely many 
graphs G„. Thus for all but finitely many G„ it holds ((f), G n ) — (4>, G„). Moreover, 
according to Lemma |9j the sequence (G„) ne N is FO-convergent and thus it holds 

lim (cj>,G n ) = lim (</>, G„). 

By using inclusion/exclusion argument and the general form of the density of 
homomorphisms of fixed target graphs to a graphon we deduce that there exists a 
polynomial P^ G 1\X\, . . . , (which depends only on <f>) such that 



lim (4>,G n ) =/•••/ Pd>((Wij(xi,Xj))i<i < j<p)dxi...dx p . 

n^oo J J 

The theorem follows. □ 



Although elementary convergence to Rado graph seems quite a natural assump- 
tion for graphs which are neither too sparse nor too dense, elementary convergence 
to other ultra-homogeneous graphs may be problematic. 

Example 2. Cherlin [TS] posed the problem whether there is a finite fc-saturated 
triangle-free graph, for each k € N, where a triangle free graph is called k-saturated 
if for every set S of at most k vertices, and for every independent subset T of S, 
there exists a vertex adjacent to each vertex of T and to no vertex of S — T. In other 
words, Cherlin asks whether the generic countable triangle-free graph has the finite 
model property, that is if it is an elementary limit of a sequence of finite graphs. 

It is possible to extend Lemma [9] to sequences of graph having a non ultra- 
homogeneous elementary limit if we restrict FO to a smaller fragment. 

Example 3. A graph G is IH-Homogeneous |13) if every partial finite isomor- 
phism extends into an endomorphism. Let PP be the fragment of FO that consists 
into primitive positive formulas, that is formulas formed using adjacency, equality, 
conjunctions and existential quantification only, and let BA(PP) be the minimum 
sub-Boolean algebra of FO containing PP. 

Following the lines of Lemma [9] and using Theorem [8] and Lemma [5] one proves 
that if a sequence of graphs (G„) ii£ n converges elementarily to some IH-homogeneous 
infinite countable graph then (G n )„ e N is BA(PP)-convergent if and only if it is QF- 
convergent. 
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5.4. FO-convergence of Graphs with Bounded Maximum Degree. We now 

consider how full FO-convergence differs to BS-convergence for sequence of graphs 
with maximum degree at most D. As a corollary of Theorems 1 1 1 1 and [9| we have: 

Theorem 15. A sequence (G n ) of finite graphs with maximum degree at most d 
such that linin^oo \G n \ = oo is FO-convergent if and only if it is both BS-convergent 
and elementarily convergent. 

6. Non-Standard Intermezzo 

We show that limit objects which are close to modelings can be obtained by 
a non-standard approach. Our goal is Theorem |18| The use of a non-standard 
approach in the area of graph and hypergraph limits was pioneered by Elek and 
Szegedy and we shall follow closely their paper pM] . 

We first recall the ultraproduct construction. Let (G n ) n< =n be a sequence of 
graphs and let U be a non-principal ultrafilter. Let G = Y\ ieN Gi and let ~ be the 
equivalence relation on V defined by (x n ) ~ (y n ) if {n : x n — y n } g U. Then the 
ultraproduct of the graphs G n is the quotient of G by ~, and it is denoted Ylu Gi. 
Two vertices [x] and [y] are adjacent if {n : x n is adjacent to y n } € U. (Notice that 
this construction easily extends to relational structures.) 

The fundamental theorem of ultraproducts proved by Los makes ultraproducts 
particularly useful in model theory. We express it now in the particular case of 
graphs indexed by N but its general statement concerns structures indexed by a set 
/ and the ultraproduct constructed by considering an ultrafilter U over I. 

Theorem 16 ([43J. For each formula (f) £ FO„ and each fi,...,f n € IL @i we 

have 

II G iM([/i], •••.[/»]) iff {* : G i M(/ 1 (i),...,/„(i))}€tf 
u 

Note that if {Gi) is elementary- convergent, then Y[u Gi is an elementary limit 
of the sequence: for every sentence cj>, according to Theorem |16[ we have 

]jG t |=0 {i : Gi ^<f>}eU. 

u 

Remark 4. It is easily checked that a (possibly infinite) A-structure G is an el- 
ementary limit of a sequence (G„)„ e N of finite A-structure if and only if every 
first-order sentence (in FOo(A)) which is true in G has a finite model. This, in 
turn, is equivalent (see |65j . Lemma 1) to the property that there exists a (count- 
able) set {Gi : i E 1} of finite A-structures and an ultrafilter U on I such that G is 
elementarily equivalent to the ultraproduct Y[jj Gi. In this sense, ultraproducts of 
finite structures are natural limit objects for elementarily convergent sequences of 
finite structures. 

A measure v extending the normalised counting measures of Gi is then ob- 
tained via the Loeb measure construction. We denote by V{Gi) the Boolean al- 
gebra of the subsets of vertices of Gi, with the normalized measure Vi(A) = t^tt. 
We define V — \\ i V(Gi)/I, where I is the ideal of the elements {Ai}j 6N such that 
{i: Ai = 0} e U. We have 

[x] € [A] iff {i : € Ai} e U. 

These sets form a Boolean algebra over JT^ Gi. Recall that the ultralimit limy a n 
defined for every (a„) ne N € ^°°(N) is such that for every e > we have 
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Define 



H : ai 6 [lim a n — e ; lim a n + ell £ U. 

u u 



v{[A]) = Wrciv^Ai). 



Then v : V — > R is a finitely additive measure. Remark that, according to 
Hahn-Kolmogorov theorem, proving that v extends to a countably additive measure 
amounts to prove that for every sequence ([.A™]) of disjoint elements of V such that 

UJA»] e v it holds KUJA"]) = E„ K^"])- 

A subset N C L]^ d is a nullset if for every e > there exists [A e ] £ such that 
N C [A e ] and ^([A e ]) < e. The set of nullsets is denoted by M. A set B C ]![/ 
is measurable if there exists B £ V such that BAB £ A/". 

The following theorem is proved in 24J: 

Theorem 17. TTie measurable sets form a a-algebra Bjj and v(B) = v(B) defines 
a probability measure on Bjj. 

Notice that this construction extends to the case where to each Gi is associated 
a probability measure v^. Then the limit measure v is non-atomic if and only if the 
following technical condition holds: for every e > and for every (A n ) £ []C7„, if 
for [/-almost all n it holds v n (A n ) > e then there exists 5 > and (B n ) £ Y[ G n 
such that for [/-almost all n it holds B n C A n and min(i/„(i? n ), v n (A n \ B n )) > 5. 
This obviously holds if v n is a normalized counting measure and limy \G n \ = oo. 
Let v be the limit measure. 

Let fi : Gi — > [— d; d] be real functions, where d > 0. One can define / : Y\ u Gi — > 
[-d;d] by 

f([x]) = limfi(xi). 

We say that / is the ultralimit of the functions {/i}ieN & n d that / is an ultralimit 
function. 

Let <fi(x) be a first order formula with a single free variable, and let ff : Gi — > 
{0, 1} be defined by 

//(,)= I' tfG * 

[0 otherwise. 

and let f^ : Y[jj Gi — > {0, 1} be defined similarly on the graph Ylu G;. Then is 
the ultralimit of the functions {ff} according to Theorem 
The following lemma is proved in |24j . 

Lemma 13. The ultralimit functions are measurable on Y[u Gi and 

f av = lim — — . 

In particular, for every formula 4>{x) with a single free variable, we have: 

"({[*] -T[Gi\=<K[x])}) =\\m{<t>,Gi). 

u 

Let ijj(x, v) be a formula with two free variables. Define fi : Gi — > [0; 1] by 

m = m • 

and let 

f(M)=^{[y}:Y[G t ^^([ X },[y}}). 
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9i(y) 



i([y}) = 



Let us check that /([x]) is indeed the ultralimit of fi(xi). Fix [x]. Let gi : Gi — > 
{0, 1} be defined by 

'\ i£Gi\=ip(x it y) 
otherwise, 
and let g : fly Gi —> {0, 1} be defined similarly by 

'i if YluGihi>(M,ly]) 

^0 otherwise. 
According to Theorem |16| we have 

n^h^NJy]) <=> {i : Gi \= ip{xi,yi)} £ U. 
u 

It follows that g is the ultralimit of the functions {ffijigN- Thus, according to 
Lemma [T3l we have 

JIG* h^(MJy])})=lim lfae ^ : ^^'^ )}l ; 

that is: 

/(N) = lim/ i (ar i ). 



Hence / is the ultralimit of the functions {/i}igN and, according to Lemma 13 we 
have 

' \([a:],[j/]) <MM) dv([y})=\im{ip,G i ). 

This property extends to any number of free variables and we have the following 
theorem. 

Theorem 18. Let U be a non-principal ultrafilter and let (G n ) n6 R be a sequence 
of graphs. 

Then there the vertex set of the ultraproduct Y[jj Gi can be equipped with a struc- 
ture of ( non-separable ) measurable space, and there exists a countably additive mea- 
sure v on Y[jj Gi such that for every first- order formula <fi £ FO p it holds: 

l ([a;i],...,[x p ]) di/([a;i]) ... du([x p ]) = \im(ip,G l ). 



7. Relational sample spaces and Modelings (particularly for 
bounded degree graphs) 

For sparse graphs the appropriate notions of limit objects seem to be relational 
sample spaces and modelings. 

7.1. Relational sample spaces. Let us recall Definition [3j Let A be a signature. 
A X-relational sample space is a A-structure A, whose domain A is a standard Borel 
space with the property that every first-order definable subset of A p is measurable. 
For every integer p, and every (j) £ FO p (A) we define 

fy(A) = {(«i, . . . , v p ) £ A p : Ah <P(v u . . . , v p )}. 

Formally, a X-relational sample space is a A-structure A, whose domain A is a 
standard Borel space such that 

V0eFO p (A) !J4A)eE^, 

where Ea is the Borel cr-algebra of A. 
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Lemma 14. Let X be a signature, let A be a \-structure, whose domain A is a 
standard Borel space with a -algebra Ea- 

Then the following conditions are equivalent: 

(a) A is a X-relational sample space; 

(b) for every integer p > and every cj) S FO p (A), it holds tl^A) g E A ; 

(c) for every integer p > 1 and every (f> G F0p Ocal (A) ; it holds fl^(A) G £ A ; 

(d) for every integers p,q > 0, every G FO p + 9 (A), and every ai, . . . , a q G A q the 
set 

{(«!,. . . ,u p ) S A p : A |= 0(ai, . . . , a q , v 1} . . -,v p )} 
belongs to S A . 



Proof. Items JaJ and Q are equivalent by definition. Also we obviously have the 
implications ([dj => Q => Q. That ([c| =>■ (|b| is a direct consequence of Gaifman 
locality theorem, and the implication (ml) => (ld| is a direct consequence of Fubini's 
theorem. □ □ 

Lemma 15. Let A be a relational sample space, let a € A, and let A a be the 
connected component of A containing a. 

Then A a has a measurable domain and, equipped with the a-algebra of the Borel 
sets of A included in A a , it is a relational sample space. 

Proof. Let <j) G FO p cal and let 

X = {(ui,..., v p ) £A p a : A a \= 4>(v!,...,v v )}. 

As <j) is local, there is an integer D such that the satisfaction of <f> only depends on 
the D-neighborhoods of the free variables. 

For every integer n£N, denote by B(A, a, n) the substructure of A induced by 
all vertices at distance at most n from a. By the locality of 0, for every v\, . . . ,v p 
at distance at most n from a it holds 



A a \= <f>(vi,...,Vp) B(A,a,n + D) \= 4>(vi,...,v p ). 



local 



However, it is easily checked that there is a local first-order formula ip n £ FO p c +1 
such that for every v\ , . . . , v p it holds 

p 

B(A,a,n+D) \= <p(vx, . .. ,Vp)Af\dist(a,Vi) < n ^=^> A (= ip. n (a,vi, . . . ,v p ). 

i=l 



By Lemma 14 it follows that the set X n = {(t>i, . . . , v n ) G A : A |= (p n (a, v\, . . . , v i 
is measurable. As X — UneN ^ n -> we deduce that X is measurable (with respect to 
S A . In particular, A a is a Borel subset of A hence A a , equipped with the cr-algcbra 
^A a of the Borel sets of A included in A a , is a standard Borel set. Moreover, it 
is immediate that a subset of A v a belongs to S A if and only if it belongs to S A . 
Hence, every subset of A p a defined by a local formula is measurable with respect to 
S A . By Lemma 14 it follows that A is a relational sample space. □ □ 



Distinguishing a single element of a A-relational sample space may be useful in 
several contexts. This can be achieved, for instance, by adding a new unary symbol 
to the signature A, and interpreting the symbol as a marking. 

Lemma 16. Let A be a X-relational sample space, let X + be the signature obtained 
from X by adding a new unary symbol M and let A + be obtained from A by marking 
a single a G A (i.e. a is the only element x of A + = A such that A + |= M(x) ). 
Then A + is a relational sample space. 
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Proof. Let <j> G FO p (A + ). There exists <fi' <G FO p +i(A) such that for every X\, . . . , x v € 
A it holds 

A + \=<f>(xi,...,x p ) <^=^ A\=<f>(a,xi,...,x p ). 
According to Lemma 14 the set of all (xi, . . . , x p ) such that A |= <p(a, x\, . . . , x p ) 



is measurable. It follows that A + is a relational sample space. □ □ 

7.2. Modelings. Let us recall Dcfinitions[4]and[5j A X-modeling A is a A-relational 
sample space equipped with a probability measure (denoted f A ). The Stone pairing 
of e FO(A) and a A-modeling A is (<fr,A) — f A (f^(A)). Notice that it follows 
(by Fubini's theorem) that it holds 

<0,A}=/ l n , (A) (x)d^(x) 

= J - J l^(A)(si,---,^) dj/ A (^i) ••• di/ A (afp)- 
Based on this extension of Stone pairing, we extend our notion of .^-convergence. 

Definition 9 (modeling X-limit). Let X be a fragment of FO(A). 
If an X-convergent sequence (A n )„ e K of A-modelings satisfies 

(V0 g X) (<P, L) = lim (0, A n ) 

n— >oo 

for some A-modeling L, then we say that L is a modeling X-limit of (A n ) ne jq. 

Recall that a A-modeling A is weakly uniform if all the singletons of A have 
the same measure. Clearly, every finite A-structure A can be identified with the 
weakly uniform modeling obtained by considering the discrete topology on A. This 
identification is clearly consistent with our definition of the Stone pairing of a 
formula and a modeling. 

In the case where a modeling A has an infinite domain, the condition for A to be 
weakly uniform is equivalent to the condition for z/ A to be atomless. This property 
is usually fulfilled by modeling X-limits of sequences of finite structures. 

Lemma 17. Let X be a fragment of TO that includes FOo and the formula {x\ = 
X2). Then every modeling X-limit of weakly uniform modelings is weakly uniform. 

Proof. Let <fi be the formula (xi = x^)- Notice that for every finite A-structure A 
it holds ((f), A) = 1/\A\ and that for every infinite weakly uniform A-structure it 
holds (0,A) = 0. 

Let L be a modeling X-limit of a sequence (A„)„ £ n- Assume lim„_ ) , 00 \A n \ = oo. 
Assume for contradiction that v-^ has an atom {v} (i.e. v-l{{v}) > 0). Then 
((f), L) > vl({v}) 2 > 0, contradicting lim„_ i . 00 ((f>, A n ) = 0. Hence v\, is atomless. 

Otherwise, \L\ = linin^oo \A n \ < oo (as L is an elementary limit of (A n ) ne jj)- 
Let N — \L\. Label v\, . . . ,vn the elements of L and let Pi — J<l ({«»}). Then 

i 2 ( l v-> \ 2 foD i 



= 1 i=l 



N N 2 

= 

Thus pi = l/N for every i = l,...,N. □ □ 

Corollary 1. Every modeling FO^ 003,1 -limit of finite structures is weakly uniform. 
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7.3. Interpretation Schemes. In model theory, the notion of interpretation of 
a A-structure in a re-structure relies on representing the A-structure inside the re- 
structure: an interpretation of B in A is a pair (k, I) where k £ N and / is a 
surjective map from a subset of A fc onto B such that the preimage by I k of every 
first-order definable subset X of B p is a first-order definable subset of A pk (see 
e.g. [3111 E]). We shall be interested here in classes of interpretations defined by a 
common set formulas. This can be formalized as follows. 

Definition 10 (Interpretation Scheme). Let re, A be signatures, where A has q 
relational symbols R\ , . . . , R q with respective arities r\,...,r q . 

An interpretation scheme I of A-structures in re-structures is defined by an integer 
k, a formula E £ F02/c(re), a formula 9q £ FOfc(re), and a formula 9i £ FO n fc(re) for 
each symbol Ri £ A, such that: 

• the formula £7 defines an equivalence relation of fc-tuples; 

• each formula Ot is compatible with E, in the sense that for every < i < q 
it holds 

A E (*J'yj) h ^(xi,...,x n ) -H- 0i(yi,...,y n ), 

where ?*o = 1, boldface Xj and y, represent fc-tuples of free variables, and 
where 0j(xi, . . . ,x r< ) stands for ^(a^i, . . . , xi. k , ■ ■ ■ ,x ri>1 , . . . ,x ril k). 
For a re-structure A, we denote by 1(A) the A-structure B defined as follows: 

• the domain B of B is the subset of the E- equivalence classes [x] C A k of 
the tuples x = (a?i, . . . , x k ) such that A |= #o( x ); 

• for each 1 < i < q and every vi, . . . , v s . £ A kVi such that A |= ^o(Vj) (for 
every 1 < J < ri) it holds 

B |= i2i([vi], . . . , [v r J) ^ A t=0i(vi,...,v ri ). 

From the standard properties of model theoretical interpretations (see, for in- 
stance [41J p. 180), we state the following: if I is an interpretation of A-structures 
in re-structures, then there exists a mapping I : FO(A) — > FO(re) (defined by means 
of the formulas E, 8q, . . . , 9 q above) such that for every tfi G FO p (A), and every 
re-structure A, the following property holds (while letting B = 1(A) and identifying 
elements of B with the corresponding equivalence classes of A k ): 

For every [vi], . . . , [v p ] £ B p (where = . . . , Uj,fc) £ A k ) it holds 

Bh0([ Vl ],...,[v p ]) ^ A|=T(0)( Vl ,...,v p ). 

It directly follows from the existence of the mapping I that an interpretation scheme 
I of A-structures in re-structures defines a continuous mapping from S(B(FO(n))) 
to 5(B(FO(A))). Thus, interpretation schemes have the following general property: 

Proposition 2. Let I be an interpretation scheme of X-structures in n-structures. 

Then, if a sequence (A n ) n€ jq of finite n-structures is FO-convergent then the 
sequence (l(A„))„ e N of (finite) X-structures is FO-convergent. 

When handling relational sample spaces and modelings, we shall be interested 
in very simple interpretation schemes, corresponding to the case where k = 1, E is 
equality, and 8q is the true statement. In such a context, we can give a simplified 
definition. 

Definition 11. Let re, A be signatures. A basic interpretation scheme I of A- 
structures in re-structures is defined by a formula 9i £ FO ri (re) for each symbol 
Ri £ X with arity r^. 
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For a Ac-structure A, we denote by 1(A) the structure with domain A such that, 
for every Ri G A with arity and every v\ , . . . , v Ti G A it holds 

1(A) |= Ri{vi, . . . ,v u ) A |= 6i(vi, . . .,v Ti ). 

It is immediate that every basic interpretation scheme I defines a mapping I : 
FO(A) — > FO(k) such that for every re-structure A, every G FO p (A), and every 
Vi, ■ ■ ■ , v p G A it holds 

1(A) h <j>{vi,...,Vp) <^=> A |= 1(0) (wi,...,w p ). 

Lemma 18. A basic interpretation scheme I of \- structures in n-structures maps re- 
relational sample spaces to X-relational sample spaces, n-modelings to X-modelings, 
and for every n-modeling A and every G FO(A) it holds 

(0, 1(A)) hi WO, A). 

Proof. Assume A is a re-relational sample space and p E N. Every subset of A p 
that is first-order definable in 1(A) is first-order definable in A, hence measurable. 
Thus 1(A) is a A-relational sample space. 

Assume A is a re-modeling. Then is a probability measure thus so is ^i(a) = 
va- Hence 1(A) is a A-modeling. 

For every £ FO p (A) and every v±, . . . , v p G A it holds 

A |=T(0) « p ) <^=> 1(A) \= (j)(v 1 ,...,vp), 
thus (1(0), A) = (0, 1(A)). □ □ 

The following strengthening of Proposition [2] in the case where we consider a 



basic interpretation scheme is a clear consequence of Lemma 18 



Proposition 3. Let I be a basic interpretation scheme of X-structures in n- 
structures. 

If L is a modeling FO-limit of a sequence (A„)„ 6 n of n-modelings then l(L) is 
a modeling FO-limit of the sequence (l(A n )) n(E N- 



Lemma 19. Let p G N be a positive integer, let L be a modeling, and let £Tp : 
L p — > S(B(FOp(X))) be the function mapping (yi, . . . ,v p ) G LP to the complete 
theory of (L, V\, ■ ■ ■ , v p ) (that is the set of the formulas if G FO p (A) such that 
L |= Lp(v l7 . . .,v p )). 

Then ^Tp is a measurable map from (L p ,T, p j ) to S(B(FO p (X))) (with its Borel 
a-algebra). 

Let (A„) n gN be an FO p (A)- convergent sequence of finite X-structures, and let [i v be 
the associated limit measure (as in Theorem^. 

Then L is an FO p (X)-limit modeling of (A„) ng N if and only if fi p is the push- 
forward of the product measure f£ by the measurable map £Tp, that is: 



Proof. Recall that the clopen sets of S(B(FO p (X))) are of the form if (0) for G 
FOp(A) and that they generate the topology of S(B(FO p (X))) hence also its Borel 
a- algebra. 

That ^Tp is measurable follows from the fact that for every G FO p the preim- 
age of K{(j>), that is ^Tp -1 ^^)) = O^(L), is measurable. 
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Assume that L is an FO p (A)-limit modeling of (A„)„ e N. In order to prove that 
lTp*(V£) = [i p , it is sufficient to check it on sets K{4>): 

^p{K{4>)) = lim (d>,A n ) = (cf>,L) = ^(PTp- 1 ^))). 

n— J-oo 

Conversely, if l"' _ P*( z/ l) = ttv then for every cj) E FO p (A) it holds 

(0,L) = ^(PTp- 1 ^))) =i h {K{<t>)) = lim (0,A„), 

hence L is an FO p (A)-limit modeling of (A„) ne pj. □ □ 

If (X, S) is a Borcl space with a probability measure v, it is standard to define 
the product er-algebra E w on the infinite product space X N , which is generated by 
cylinder sets of the form 

R = {feL N : f(h)eA il ,...,f{i k )eA ik } 

for some k £ N and A^, . . . ,Ai k £ S. The measure v u of the cylinder R defined 
above is then 

k 

By Kolmogorov's Extension Theorem, this extends to a unique probability measure 
on E w (which we still denote by z/ 1 '). We summarize this as the following (see also 
Fig.|73|. 

Theorem 19. let L be a modeling, and let £Tp : L N -> 5(B(FO(A))) 6e f/ie 
function mapping f £ L N to the point of S(B(FO(X))) corresponding to the set 

\o:L | oi/il) /(<),...)}■ 

Then £Tp is a measurable map. 
Let (A n )„ g N be an FO{X)-convergent sequence of finite X-structures, and let [i be 
the associated limit measure (see Theorem^. 

Then L is an FO(X)-limit modeling of (A„)„ g n if and only if 

l t P*(^l) = M- 

□ 
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Figure 3. Pushforward of measures 
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Remark 5. We could have considered that free variables are indexed by Z instead 
of N. In such a context, natural shift operations S and T act respectively on the 
Stone space S of the Lindendaum-Tarski algebra of FO(A), and on the space L z of 
the mappings from Z to a A-modeling L. If (A„) ng pj is an FO-convergent sequence 
with limit measure /x on S, then (S, /z, S) is a measure-preserving dynamical system. 
Also, if i/ z is the product measure on A, (A z , v, T) is a Bernoulli scheme. Then, the 
condition of Theorem [19] can be restated as follows: the modeling L is a modeling 
FO-limit of the sequence (A„)„ s n if and only if (<S, fx, S) is a factor of (A z , z^ z , T). 
This setting leads to yet another interpretation of our result, which we hope will 
be treated elsewhere. 

7.4. Modeling FO-limits for Graphs of Bounded Degrees. Nice limit ob- 
jects are known for sequence of bounded degree connected graphs, both for BS- 
convergence (graphing) and for FOo-convergence (countable graphs). It is natural 
to ask whether a nice limit object could exist for full FO-convergence. We shall 
now answer this question by the positive. First we take time to comment on the 
connectivity assumption. A first impression is that FO-convergence of disconnected 
graphs could be considered component-wise. The following examples shows that 
this is far from being true in general. The contrast between the behaviour of graphs 
with a first-order definable component relation (like graphs with bounded diameter 
components) and of graphs with bounded degree is exemplified by the following 
example. 

Example 4. Consider a BS-convergent sequence (G„)„ £ n of planar graphs with 
bounded degrees such that the limit distribution has an infinite support. Note 
that lim n _j. 00 \G n \ = oo. Then, as planar graphs with bounded degrees form a 
hyperfinite class of graphs there exists, for every graph G n and every e > a 
subgraph 5(G„,e) of G n obtained by deleting at most e|G n | of edges, such that 
the connected components of S(G n ,e) have order at most /(e). By considering a 
subsequence G s („) we can assume lim^^oo |G s („)|//(l/n) = oo. Then note that the 
sequences (G s (n)) n6 N and (<S'(G s ( n ), l/n))„ e pj have the same BS-limit. By merging 
these sequences, we conclude that there exists an po local convergent sequence of 
graphs with bounded degrees (H n ) such that H n is connected if n is even and such 
that the number of connected components of H n for n odd tends to infinity. 

Example 5. Consider four sequences (A„)„ eN , (S„)„ eN , (G„) neN ,(X>„) neN of FO- 
converging sequences where \A n \ = \B n \ = \C n \ = \D n \ grows to infinity, the 
sequences have distinct limits, and each of A n , B ni C n , D n contains an induced 
path of length n. Then we can construct a sequence (G n )neN of graphs with two 
connected components H n \ and H n ^ obtained by cutting the induced paths in 
A n , B n ,C n and D n in their middle and alternatively gluing A n with G„ and B n 
with D n , or A n with D n and B n with C n (see Fig. [I]). Then (G n ) ne n is FO- 
convergent. However, there is no choice of a mapping / : N — > {1,2} such that 
(iJ„j(„)) is FO-convergent (or even BS-convergent). 

This situation is indeed related to the fact that the diameter of the graph G n in 
the sequence tend to infinity as n grows and that the belonging to a same connected 
component cannot be defined by a first-order formula. This situation is standard 
when one consider BS-limits of connected graphs with bounded degrees: it is easily 
checked that, as a limit of connected graphs, a graphing may have uncountably 
many connected components. 

Let V be a standard Borel space with a measure /i. Suppose that Ti,T2, . . . , Tj~ 
are measure preserving Borel involutions of X. Then the system 

G = (V,T 1) T 2 ,...,r fc ,/i) 
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Figure 4. An FO-converging sequence with no component selection 



is called a measurable graphing (or simply a graphing) [T] . A graphing G determines 
an equivalence relation on the points of V. Simply, x ~g y if there exists a sequence 
of points (x\, X2, • ■ ■ , Xm) of X such that 

• xi = x,x m = y 

• Xi + \ = Tj[xi) for some 1 < j < k. 

Thus there exist natural a simple graph structure on the equivalence classes, the 
leafgraph. Here x is adjacent to y, if x ^ y and Tj[x) = y for some 1 < j < k. Now 
if If V is a compact metric space with a Borel measure \i and Ti , T2, . . . , T^ are 
continuous measure preserving involutions of V, then G = (V, Ti, T2, . . . , Tfe, /Li) is a 
topological graphing. It is a consequence of [5] and |29) that every local weak limit 
of finite connected graphs with maximum degree at most D can be represented as 
a measurable graphing. Elek [23] further proved the representation can be required 
to be a topological graphing. 

A graphing defines an edge coloration, where {x, y} is colored by the set of the 
indexes i such that y = Ti(x). For an integer r, a graphing G = (V, Ti, . . . , fi) 
and a finite rooted edge colored graph (F, o) we define the set 

D r (G,(F,o)) = {xe G,B r (G,x) ~ (F,o)}. 
It is easily checked that D r (G, (F, o)) is measurable. 

Considering fc-edge colored graphing allows to describe a vertex a; in a distance- 
r neighborhood of a given vertex v by the sequence of the colors of the edges 
of a path linking v to x. Taking, among the minimal length sequences, the one 
which is lexicographically minimum, it is immediate that for every vertex v and 
every integer r there is a injection L v>r from B r (G,v) to the set of the sequences 
of length at most r with values in [k]. Moreover, if B r (G,v) and B r (G,v') are 
isomorphic as edge-colored rooted graphs, then there exists a unique isomorphism 
/ : B r (G,v) — > B r (G,v') and this isomorphism as the property that for every 
x G B r (G, v) it holds iv,r'(f(x)) — L v . r (x). 

Lemma 20. Every graphing is a modeling. 
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Proof. Let G = (V, 7i, . . . , Td, fi) be a graphing. We color the edges of G according 
to the the involutions involved. 

For r e N, we denote by J> the finite set of all the colored rooted graphs that 
arise as B r (G,v) for some v £ V. To every vertex v £ V and integer r £ N we 
associate t r (v), which is the isomorphism type of the edge colored ball B r (G, v). 

According to Gaifman's locality theorem, in order to prove that G is a modeling, 
it is sufficient to prove that for each 4> £ FO p ocal , the set 

X = {(wi,... ,<) £ V q : G |= 

is measurable (with respect to the product cr-algebra of V p ). 

Let L £ N be such that <j> is L- local. For every v = (i>i , . . . , v p ) £ X wc define the 
graph T(v) with vertex set {v\, . . . , v p } such that two vertices of T(v) are adjacent if 
their distance in G is at most L. We define a partition "P(v) of [p] as follows: i and 
j are in a same part if and u,- belong to a same connected component of T(v). To 
each part P £ V(v), we associate the tuple formed by Tp = i(|p|-i)L(^minp) and, 
for each i £ P — {minP}, a composition Fp^ —T il o-- ■oT ij with 1 < j < (|P| — 1)L, 
such that Vi — fpi(v m inp)- Wc also define Fp ;m i n p as the identity mapping. 
According to the locality of <f>, if v' = (v[, . . . , v' p ) £ V p defines the same partition, 
types, and compositions, then v' £ X. For fixed partition V, types (Tp)p e -p, 
and compositions (Fp^iePev , the corresponding subset X' of X is included in a 
(reshuffled) product Y of sets of tuples of the form (i*p,i(x m i n p)) for w m i n p £ Wp, 
and is the set of all v £ G such that B^ P ^_ 1 - )L (G, v) = T P . Hence Wp is measurable 
and (as each Fp^ is measurable) Y is a measurable subset of G' p '. Of course, this 
product may contain tuples v defining another partition. A simple induction and 
inclusion/exclusion argument shows that X' is measurable. As X is the union of a 
finite number of such sets, X is measurable. □ □ 

We shall make use of the following lemma which reduces a graphing to its essen- 
tial support. 

Lemma 21 (Cleaning Lemma). Let G = (V, T\, . . . , T^, /z) be a graphing. 

Then there exists a subset X £ V with measure such that X is globally invariant 
by each of the Ti and G' = (V — X, Ti, . . . , Tj, /«) is a graphing such that for every 
finite rooted colored graph (F, 6) and integer r it holds 

li(D r (G',(F,o)))= fi (D r (G,(F,o))) 

(which means that G' is equivalent to G) and 

D r (G , ,(F,o)) 9 6 n(D r (G',(F,o)))>0. 

Proof. For a fixed r, define J> has the set of all (isomorphism types of) finite rooted 
fc-edge colored graphs (F,o) with radius at most r such that /j,(D r (G, (F,o))) = 0. 
Define 

A=|J |J D r (G,(F,o)). 

refi (P,o)GJ r r 

Then fJb{X) — 0, as it is a countable union of 0-measure sets. 

We shall now prove that A is a union of connected components of G, that is 
that X is globally invariant by each of the Ti. Namely, if x £ X and y is adjacent 
to x, then y £ X. Indeed: if x £ X then there exists an integer r such that 
fi(D(G, B r (G, x))) = 0. But it is easily checked that 

n(D(G,B r+1 (G,y)))<d-n(D(G,B r (G,x))). 
Hence y £ X. It follows that for every 1 < i < d we have Ti(X) = X. So we can 
define the graphing G' = (V - X, 7\, . . . , T d , fi). 
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Let (F, 6) be a rooted finite colored graph. Assume there exists x G G' such 
that B r (G',r) ~ (F, o). As X is a union of connected components, we also have 
B r (G,r) ~ (F,o) and x ^ X. It follows that fi(D(G, (F, o))) > hence it holds 
//(Z? r (G',(F,o))) >0. □ □ 



The cleaning lemma allows us a clean description of FO-limits in the bounded 
degree case: 

Theorem 20. Let (G„)„ e N be a FO-convergent sequence of finite graphs with max- 
imum degree d, with lim n _>. 00 \G n \ = oo. Then there exists a graphing G, which is 
the disjoint union of a graphing Go and a countable graph G such that 

• The graphing G is a modeling FO-limit of the sequence (G n )rigN- 

• The graphing Go is a BS-limit of the sequence (G n ) n6 N such that 

D r (G ,(F,o))^H) fi(D r (G ,(F,o)))>0. 

• The countable graph G is an elementary limit of the sequence (G n ) n ^. 



Proof. Let Go be a BS-limit, which has been "cleaned" using the previous lemma, 
and let G be an elementary limit of G. It is clear that G = GoUG is also a BS-limit 
of the sequence, so the lemma amounts in proving that G is elementarily equivalent 
to G. 

According to Hanf's theorem [33], it is sufficient to prove that for every integers 
r, t and for every rooted finite graph (F, o) (with maximum degree d) the following 
equality holds: 



min(i, \D r (G, (F,o))\) = min(t, \D r (G, (F,o))\). 

Assume for contradiction that this is not the case. Then \D r (G,(F,o))\ < t and 
_D r (G , (F, o)) is not empty. However, as Go is clean, this implies fi(D r (Go, (F, o))) = 
a > 0. It follows that for every sufficiently large n it holds \D r (G n ,(F,o))\ > 
a/2 \G„ \ > t. Hence \D r {G, (F, o))| > t, contradicting our hypothesis. 



That G is a modeling then follows from Lemma 20 □ □ 



Remark 6. Not every graphing with maximum degree 2 is an FO-limit modeling of a 
sequence of finite graphs. Indeed: let G be a graphing that is an FO-limit modeling 
of the sequence of cycles. The disjoint union of G and a ray is a graphing G', which 
has the property that all its vertices but one have degree 2, the exceptional vertex 
having degree 1. As this property is not satisfied by any finite graph, G' is not the 
FO-limit of a sequence of finite graphs. 

Let us finish this section by giving an interesting example, which shows that the 
cleaning lemma sometimes applies in a non-trivial way: 

Example 6. Consider the graph G„ obtained from a De Bruijn sequence of length 
2™ as shown Fig [5] 

It is easy to define a graphing G, which is the limit of the sequence (G n ) n ^: as 
vertex set, we consider the rectangle [0; 1) x [0; 3). We define a measure preserving 



A UNIFIED APPROACH TO STRUCTURAL LIMITS 



43 




Figure 5. The graph G n is constructed from a De Bruijn sequence 
of length 2". 



function / and two measure preserving involutions T 1; r 2 as follows: 

'(2x,y/2) if x < 1/2 and y < 1 

(2a;- l,(y + l)/2) if 1/2 < x and y < 1 



f(x,y) 



(x,y) 



otherwise 





'(i.y + l) 


if y < 1 






1) 


if 1 < y < 2 






k (a>y) 


otherwise 










1) if x < 1/2 


and 1 < y < 2 






0,y + 


2) if 1/2 < ac 


and y < 1 


T2(x,y) = 






1) if x < 1/2 


and 2 < y 






{x,y- 


2) if 1/2 < x 


and 2 < y 






(x,v) 


otherwise 





Then the edges of G are the pairs {(x, y), (x' , y')} such that (x, y) ^ (x' , y') and 
either (x',y') = f(x,y), or (x,y) = f{x',y'), or (x',y') = Ti{x,y), or (x',y r ) = 
T 2 (x,y). 

If one considers a random root (x,y) in G, then the connected component of 
(x, y) will almost surely be a rooted line with some decoration, as expected from 
what is seen from a random root in a sufficiently large G n . However, special be- 
haviour may happen when x and y are rational. Namely, it is possible that the 
connected component of (x,y) becomes finite. For instance, if x = 1/(2™ — 1) and 
y = 2 n ~ 1 x then the orbit of (x, y) under the action of / has length n thus the 
connected component of (a;, y) in G has order 3n. Of course, such finite connected 
components do not appear in G n . Hence, in order to clean G, infinitely many 
components have to be removed. 

Let us give a simple example exemplifying the distinction between BS and FO- 
convergence for graphs with bounded degree. 
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Example 7. Let G n denote the n x n grid. The Benjamini-Schramm limit object 
is a probability distribution concentrated on the infinite grid with a specified root. 
A limit graphing can be described as the Lebesgue measure on [0, l] 2 , where (x, y) 
is adjacent to (x ± a mod 1, y ± a mod 1) for some irrational number a. 

This graphing, however, is not an FO-limit of the sequence (G„)„ s n as every FO- 
limit has to contain four vertices of degree 2. An FO-limit graphing can be described 
as the above graphing restricted to [0, l) 2 (obtained by deleting all vertices with 
x = 1 or y = 1). One checks for instance that this graphing contains four vertices of 
degree 2 (the vertices (a, a), (1 — a, a), (a, 1 — a), and (1 — a, 1 — a)) and infinitely 
many vertices of degree 3. 

We want to stress that our general and unifying approach to structural limits 
was not developed for its own sake and that it provided a proper setting (and, 
yes, encouragement) for the study of classes of sparse graphs. So far the bounded 
degree graphs are the only sparse class of graphs where the structural limits were 
constructed efficiently. (Another example of limits of sparse graphs is provided by 
scaling limits of transitive graphs [5j which proceeds in different direction and is 
not considered here.) The goal of the remaining sections of this article is to extend 
this to strong Borel FO-limits of rooted trees with bounded height and thus, by 
means of a fitting basic interpretation scheme, to graphs with bounded tree-depth 
(defined in [50]), or graphs with bounded SC-depth (defined in [3"T]). 

8. Merging Limits: Combinations of Modelings 

The combinatorics of limits of equivalence relations (such as components) is com- 
plicated. As a first approximation towards analysis we consider the combinatorics 
of "large" equivalence classes. This leads to the notion of spectrum, which will be 
analyzed in this section. 

8.1. Spectrum of a first-order equivalence relation. 

Definition 12 (ro-spectrum). Let A be a A-modeling (with measure va), and let 
zu e F02(A) be an equivalence relation on A. Let {Ci : i € T} be set of all the 
■^-equivalence classes of A, and let r + be the (at most countable) subset of T of 
the indexes i such that ^a(Ci) > 0. 

The zo -spectrum Sp ra (A) of A is the (at most countable) sequence of the values 
v A (Ci) (for i € r_|_) ordered in non- increasing order. 

Lemma 22. For k e N, let zu^ be the formula A<=i w { x ii x i+x)- Then it holds 

VA{^) k+1 = {vo {k \A). 

ier + 

Proof. Let k e N. Define 

D k+1 = {{ Xl ,...,x k+1 ) £ A k+1 : A |= zu k (x u ...,x k+ i)}. 

According to Lemma 15 each Ci is measurable, thus Uier + ^ ' s measurable 
and so is R = A \ U;er + ^i- 

Considering the indicator function l Dk+inR k+i of D k +i l~l R k+1 and applying 
Fubini's theorem, we get 

J lD fc+1 nfl fc + 1 dl/ A +1 = J ' ' ' J iflC^i.- ■ -,Xk+i) dv A (xi, . . .,Av A {x k+ i) = 0. 
as for every fixed a\, . . . ,a k (with a\ G C a , for some a G T \ T + ) we have 

< / l_R(ai, • ■ • , a k ,x k+1 ) di^ A (a;fe+i) < v A (C a ) = 0. 
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It follows (by countable additivity) that 

(wW, A) = » k A + \D k+1 ) = |J Cf +1 ) = ^(Ci) k+1 - 



ier + ier + 
□ □ 



It follows from Lemma 22 that the spectrum Sp ro (A) is computable from the 
sequence of (non-increasing) values ({vj^ k \ A))keN- 

We assume that every finite sequence x = (xi, . . . , x„) of positive reals is implic- 
itly embedded in an infinite sequence by defining x. k — for i > n. Recall the usual 
Ik norms: 

l/k 



Xi\ k 



Hence above equations rewrite as 

(4) ||Sp ro (A)|| fc+1 = (^ fe ),A) 1 /(fe+D 

We shall prove that the spectrum is, in a certain sense, defined by a continuous 
function. We need the following technical lemma. 

Lemma 23. For each n £ N, let a„ = (a n ,i)jgN be a non-increasing sequence of 
positive real numbers with bounded sum (i.e Ha^Hi < oo for every n £ N). 

Assume that for every integer k > 1 the limit Sj. = lim,,^^ ||a„||s, exists. 

Then (a„) n6 N converges in the space cq of all sequences converging to zero (with 
norm \\ ■ W^). 

Proof. We first prove that the sequences converge pointwise, that is that there 
exists a sequence x = (xj)j e N such that for every i £ N it holds 



lim a ni . 

n— >oo 



For every e > 0, if Sk < e then a n ^\ < 2e for all sufficiently large values of n. 
Thus if Sk — for some k, the limit lining a n ^ exists for every i and is null. Thus, 
we can assume that Sk is strictly positive for every k G N. 

Fix k e N. There exists JVeN such that for every n > N it holds |s| — ||a„|| fe | < 
Sk/k. As (a n! i)i S N is a non-increasing sequence of positive real numbers, for every 
n ^ N it holds 

and 

Hence 



a, 



a k -^>\\a n t>JS t {X-l/k) 



log(l + l/fc) , , 1 Wl log(l-l/fe), 

logs fc + \ >loga n ,i > (1 + t— r)(loggfc+ k ) 

Thus X\ — limn^oo a n< i exists and X\ — lirm-^oo s& ■ Inductively, we get that for 
each i £ N, the limit Xj = limn-^ a n ,j exists and that 

Xi = Hm (sl-Y,^- 

k— yao ' — ' J 

j<i 

We now prove that the converge is uniform, that is that for every e > there 
exists ./V such that for every n > N it holds 

|| X _ a 7l||oO < £■ 

As a„ £ £i and ||a„||i converges there exists M such that ||a„||i < M for every 
ri € N. Let e > 0. Let A = min{i : Xj < e/3}. (Note that A < 3M/e.) There exists 



46 



JAROSLAV NESETRIL AND PATRICE OSSONA DE MENDEZ 



N such that for every n > N it holds sup i<j4 \xi — a n ,i\ < e/3. Moreover, for every 
i > A it holds 

< a„,i < a n> A < xa + e/3 < 2e/3. 
As < A, < e/3 for every i > A it holds 

|£j - On,, | < e 

for every i > A (hence for every i). Thus (a„) nG N converges in l^. As obviously 
each a n has limit, (a n )„ e N converges in cq. □ □ 



Lemma 24. Lei A be a signature. The mapping A t— > Sp m (A) is a continuous 
mapping from the space of X-modelings with component relation w (with the topology 
of F0 local (A) -convergence) to the space cq of all sequences converging to zero (with 
|| ■ Hoc norm). 



Proof. Assume A„ is an F0 local (A)-convergent sequence of A-modelings. 

Let (A n ,i, . . . , X n .i, ■ • ■ ) be the zn-spectrum of A n (extended by zero values if 
finite), and let a n = (a n i ) i( zpj be the sequence defined by a n ^ = A„ ^ Then for 
every integer k > 1 it holds 



= ||Sp ro (A„)||^ = (^- 1 ),A„) 1 / fc . 



Hence s^ = limn^oo ||a„||fc exists. According to Lemma 23 (a„) ne jj converges in 



cq, thus so does (Sp ro (A„))„ eN . □ □ 

8.2. Component-Local Formulas. 

Definition 13 (Component relation). Let A be a signature and let A be a A- 
relational structure. 

A binary relation w € A is a component relation of A if it is complete on the 
connected components of A. 

The property of w to be a component relation can be axiomatized by a sentence 
and we shall denote by K,^ the class of all A-structures for which w is a component 
relation. Note that in some applications, the relation w can be defined through a 
basic interpretation scheme. 

A local formula <p with p free variables is w-local if cj> is equivalent (in /C CT ) to 
<f> A Af=i w { x ii Xi+i)- F° r two w-local formulas <f>\, (f>2 we denote by <pi J\ fa the 
formula fa A fa A vj(x a ,Xb) where x a £ Fv(</>i) and xi, £ Fv(fa). Notice that 
fa A_ ct fa is, by construction, a nj-local formula. 

Recall that & n denotes the symmetric group of {1, . . . ,n}. For a permutation 
a E 6„, we denote by [n]/cr the set of the orbits of a. Elements of [n]/a (that is: 
orbits) are identified with the corresponding subsets of [n] . 

The basis observation is that for tu-local formulas, we can reduce the Stone 
pairing to components. 

Lemma 25. Let A be a X-modeling and component relation w. Let ip £ FO p (A) 
be a w -local formula of A. 

Assume A has countably many connected components {Ai}i g r- Let T + be the 
set of indexes i such that VA.(Ai) > 0. For i € T + we equip Aj with the a-algebra 
an d the probability measure v^, where Ea ; is restriction o/Sa to A4 and, for 
X k S A<} v^X) = is A {X)/v A (A t j. Then 

(V,A) =^^ A (A J ) p (V,A l ). 
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Proof. First note that each connected component of A is measurable: let Aj be a 
connected component of A and let a <E Ai. Then Ai = {x € A : A |= m(x, a)} 
hence Ai is measurable as A is a relational sample space. Let Y = {(l>i, . . . , v p ) £ 
A p : A |= i/j(vi, . . . , Vp)}. Then (ip,A) = v p A (Y). As tp is nj-local, it also holds 
Y = U i& r Y h where Y t = {(v u ...,v p ) : A 4 \= ij>(v u . . . ,v p )} = Y n A\. As 
Ai E Sa and Y <G E A , it follows that 1^ € S A and (by countable additivity) it 
holds 

(V, A) = ^(Y) = E<(^) - E "ACAi^W) - E^(A,) P <V>, A 4 >. 

□ □ 

Corollary 2. Le£ A be a finite X-structure with component relation w. Let ip € 
FOp(A) be a w -local formula of A. 

Let Ai, . . . , A„ be the connected components of A. Then 

In the aim of extending this reduction result to all local first-order formulas 
(Theorem 21 1, we consider, as a first step, the case of finite conjunctions of ro-local 
formulas. 

Lemma 26. Let ip±,...,ip n be w -local formulas. 
Then for modeling A £ K.^ it holds 

n 

»=1 ff£6„ Ce[n]/CT ieC 

Proof. For each i = 1, ...,n select some x a . in Fv(-0 i ). For a partition r of [n] 
we denote by £ T the conjunction of w{x ai ,x a .) for every i,j belonging to a same 
part and of -tzu(x ai , x a .) for every i,j belonging to different parts. Then it is easily 
checked that every partition r of [n] it holds 

n 

IKA>< A > = E^ A A^ A >- 

C£t i£C t'>t i=l 

Recall that the Mobius function of the lattice of the partitions of [n] is 

n 

/ i(r ) r') = (-l) |T| - |T ' i n(( i - 1 ) ! ) r S 

where |r| is the number of parts of t and r.i is the number of parts of r' that are 
unions of i parts of r. 

Moreover, to every permutation a G &„ we can associate the partition [n]/a. 
Note that a partition r of [n] is obtained from exactly Il™=3((*~ permutations 
where rii is the number of parts of r with exactly n$ elements (see for instance 
0153]). 

By Mobius inversion, denoting by tq the trivial partition with all parts of size 1, 
it holds 

n 

(/\^,A) =X(-l) |rolHT| M(ro,r) H(A ro ^' A ) 

i=l r CGt ieC 

= E(-D e(a) n <a,> a >- 

o-ee„ ce[n]/a iec 

□ □ 
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We are now ready to reduce Stone pairing of local formulas to Stone pairings 
with tJ7-local formulas. 

Lemma 27. Let cf> G F0p Ocal (A). Then there exist, for every partition r of [p] with 
parts Ii, . . . ,I\ T \, tv -local formulas <f> T i (with 1 < i < \t\) with free variables Xj (for 
j G Ii) and constants Ci such that for modeling A G JC m it holds 

(<p,a)=j2Y1 E (-!) eW n (A ro (^© c »)' A )- 

T cGC T ctSS| t | -Pe[|r|]/<j iGP 

Proof. For a partition r of [p] we denote by £ r the conjunction of w(xi, Xj) for every 
i,j belonging to a same part and of ->zu(xi, Xj) for every i,j belonging to different 
parts. Then, for any two distinct partitions r and r', the formula A (' T is never 
satisfied; moreover \J T £ r is always satisfied. Thus 

= \/(Cr A 0) 
r 

and, as the terms of the disjunction are mutually exclusive, it holds 

(0,A) =^(C r A^,A). 

T 

For every partition r with parts 7i,...,J| T i there exist ro-local formulas <j) T ^ 
(with 1 < i < |r|) with free variables Xj (for j G Ij) and a Boolean function g T , 
such that it holds 

A|=C T A0 ^=> A |= g r ((/>T,i, ■ ■ ■ ,<Pt,\t\)- 

Denote by © the exclusive disjunction, so that for every ip it holds ip(&0 = ip and 
ip® 1 = iip. By considering the truth-table of g T we can expand g T (</> T) i, . . . , t .|t|) 
as 

|r| 

V A^® Ci )' 

c6CV i=l 

where C T is a subset of {0, 1}' T ' . Note that the terms of the disjunction are mutually 
exclusive and that ^4> T ^ is w-local, as 4>r,i is t*7-local. Hence 

\r\ 

(^A)=^^(/\(^© Ci ),A). 

t eSCV i=l 

According to Lemma [26] it holds 
M 

(/\(<t>r,i®Ci),A) = J2 IT (A ro (^© C »)' A )- 

i=i creS| T | fe[|T|]/<7 ieP 

Hence 

<^ A > = EE E (- 1 ) eW II <A ro (<^© c >)> A >- 

t cecv <re6 M Fe[|-r|]/<7 ieP 

□ □ 

We can deduce the generalization of Lemma [25] to local formulas. 
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Theorem 21. Let peN and <j> £ F0p Ocal (A). There is an integer s, finite sets Ii 
(for 1 < i < s), values ti £ { — 1,1} (for 1 < i < s), and formulas tpij £ F0p Ocal 
(for 1 < i < s and j £ Ii ) such that for every modeling A with component relation 
w, and countable set of connected components {Ak}ker, it holds 

s 



Proof. This is a direct consequence of Lemma 27 and Lemma 25 □ □ 

The case of sentences can be handled easily. For a set X and an integer m, define 

'l if|X|>m 



otherwise 



Big m (X) = 

Lemma 28. Let 9 £ FO (A). 

Then there exist formulas ipx } . . . , ip s £ YO l ° cal with quantifier rank at most 
q(qrank(#)) ; integers mi, . . . ,m s < qrank(0), and a Boolean function F such that 
for every X-structure A with component relation w and connected components 
(i £ I), the property A |= 6 is equivalent to 

^(Big mi ({», B, |= (Bx)ih(x)}), ■ • ■ , Big ms {{i, Bi h (3x)Mx)})) - 1- 



Proof. Indeed, it follows from Gaifman locality theorem [10] that — in presence of 
a component relation w — every sentence 9 with quantifier rank r can be written 
as a Boolean combination of sentences 9k of the form 

3yi...3y mk l f\ ->m{yi, yj) A f\ ipk(yi) 

where ^fc is tn-local, mk < qrank(0), and qrank(-0fe) < q(qrank(0)), for some fixed 
function q. As A |= 9k if and only if Big mfc ({i,Bi \= (3x)ipk(x)}) = 1, the lemma 
follows. □ □ 

8.3. Convex Combinations of Modelings. In several contexts, it is clear when 
disjoint union of converging sequences form a converging sequence. If two graph 
sequences (G n )neN and (ff„)„ S N are L-convergent or BS-convergent, it is clear that 
the sequence (G„ U iJ n ) n£ [j is also convergent, provided that the limit 

lim |G„|/(|G„| + \H n \) 

n— toe 

exists. The same applies if we merge a countable set of L-convergent (resp. BS- 
convergent) sequences (H n ^) ne fi (where i £ N), with the obvious restriction that 
for each i £ N all but finitely many H n ^ are empty graphs. 

We shall see that the possibility to merge up to a countable set of converg- 
ing sequences to F0 local -convergence will need a further assumption, namely the 
following equality: 

E„ |G n .i| 
lim 
Ti — vr* 



\JjG nd \ ■ 

The importance of this assumption is illustrated by the next example. 
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Example 8. Let N n = 2 2 " (so that N(n) is divisible by 2 l for every 1 < i < 2 n ). 
Consider sequences (H n _i) ne ^ of cdgeless black and white colored graphs where 
H-n,i is 

• empty if i > 2™, 

• the edgeless graph with (2~ l + 2~ n )N n white vertices and 2~ l N n black 
vertices if n is odd, 

• the edgeless graph with (2~ l + 2~ n )N n black vertices and 2~ i N n white 
vertices if n is even. 

For each i £ N, the sequence (i? nj i) n GN is obviously L-convergent (and even FO- 
convergent) as the proportion of white vertices in H n ^ tends to 1/2 as n — > oo. The 
order of G„ = UieN H n ,i is 3AT n and 1 7?^^ |/ | tends to §-2~* as n goes to infinity. 
However the sequence (G n )raeN is not L-convergent (hence not F0 local -convergent). 
Indeed, the proportion of white vertices in G n is 2/3 if n is odd and 1/3 is n is 
even. 

Definition 14 (Convex combination of Modelings). Let EL be A- modelings for 
ie/CN and let (ai) ie i be positive real numbers such that J2 ieI 0^ = 1. 

Let H be the disjoint union of the EL, let Eh = {Ui %i '■ G ^Hi} and, for 
X € E H , let vr(X) = Ei^i^iX n Hi). 

Then H is the convex combination of modelings EL with weights on and we 
denote it by LL e/ (EL, at). 

Lemma 29. Let EL be X-modelings for ie/CN and let (cti)i£j be positive real 
numbers such that on = 1. Let H = U ig /(EL, a,) TTien 

(1 j H is a modeling, each Hi is measurable and ^h(-Hi) = on holds for every 
i G I; 

(2) if all the EL are weakly uniform and either all the Hi are infinite or all 
the Hi are finite, L is finite, and a% — \Hi\/ J2 ieI \Hi\, then H is weakly 
uniform. 

Proof. We consider the signature A + obtained from A by adding a new binary 
relation w, and the basic interpretation scheme L of A + -structures in A-structures 
corresponding to the addition of the new relation w by the formula 9^ — 1. This 
means that for every A-structure A it holds L(A) |= Vx,y w{x,y). Let H^" = 
b(Hj). This is a weakly uniform modeling. 

Let H+ = U ie j(H^", cti). Clearly, the family E H + is a tr-algebra, (H, E H +) is a 
standard Borel space, and z^h+ is a probability measure. Moreover, by construction, 
Hf is measurable and Wn+{Hf) = on. 

Let (ft £ FOp(A). First notice that for every (v±,... ,v p ) G H p+q (which is also 
(H+)p+i) it holds n (H) = fy(H+), that is: 

H |= <f>(vi, ■ ■ ■ ,v p ) <*=S> H + |= <j>(vi,...,v p ). 

that the set £l < p(H + ) may be obtained as a Boolean 



It follows from Lemma 27 



combination of products of sets defined by tzj-local formulas. So, we can assume 
that (ft is tu-local. Then Sl0(H + ) is the union of the sets f2^(Hj). All these sets are 
measurable (as EL is a modeling) thus their union is measurable (by construction 
of Eh)- It follows that H + is a modeling, and so is H = H + — w. 

Assume that all the EL are weakly uniform. If all the EL arc finite, / is finite, 
and cti — \Hi\/^2 ieI \H\, then H is the modeling associated to the union of the 
Hi hence it is weakly uniform. Otherwise all the Hi arc infinite, hence all the ^h ; 
are atomless, vn is atomless, and H is weakly uniform. □ □ 

Lemma 30. Let p £ N and (ft £ F0p Ocal (A). There is an integer s, finite sets Ii 
(for 1 < % < s), values ej £ { — 1,1} (for 1 < i < s), and formulas ipij £ F0p Ocal 
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(for 1 < i < s and j £ Li) such that for every countable set of modelings Aj and 
weights ctj (j £ J CN and ■ ctj = 1) it holds 

s 

(4>,a) =j2 e * nE^^'' A ^ 

i=i je/i ker 

Proof. Considering, as above, the combination H + = JJ ie/ (H+ , a^), where H+ is 
obtained by the basic interpretation scheme adding a full binary relation w, the 



result is an immediate consequence of Theorem, 21 □ □ 



Theorem 22. Let p £ N, let I C N and, for each i £ I let (Aj „) n gN be an 
F0p Ocal (A) -convergent sequence of X-modelings and let (ai. n )„ e N be a convergent 
sequence of non-negative real numbers, such that X^e/ a h n ~ ^ holds for every 
n £ N, and such that J^igj nm »n-oo &i,r» = 1. 

Then the sequence of convex combinations Uj e j(Aj )n , ai jn ) is FOp ocal (A)- 



Proof. If / is finite, then the result follows from Lemma 30 Hence we can assume 
J = N. 

Let 4> £ F0p Ocal , let q £ N, and let e > be a positive real. Assume that for 
each i £ N the sequence (Af i7l ) ne N is FOp° cal -convergent and that (a, )n ) n£ N is a 
convergent sequence of non-negative real numbers, such that Ej a^ n = 1 holds 
for every n £ N. Let 014 = lim„_i. 00 a^ n , let di = lim n _ > . 00 (<^, Aj jn ), and let C be 
such that Ei=i aj > 1 — e/4. There exists TV such that for every n > N and 
every i < C it holds |a n i — a,-| < e/4C and |a| n (0, Aj in ) — otfdi\ < e/2C. Thus 

J2i=i 0?, n (^) A i,n) ~ Ei=i a ^ < e / 2 and Ei>C+l a «,» < e / 2 - Ii; follows that for 
any n > N it holds 



1 

i>C+l i>C+l 

hence | Ei <„(<^ A »,»> ~ Ei < e - 



< max a im <4di J < e/2 

\4>C+1 i>C+l ) 



For every ^ £ F0p Ocal , the expression appearing in Lemma 30 for the expansion 



of (((>, Uj(Aj jn , aj, n )) is a finite combination of terms of the form '^2 i a q i n {4>, A.i^ n ) , 
where q £ N and (j> G FO p ocal . It follows that the value ((/>, IXj(Aj jn , aj, n )) converges 
as n grows to infinity. Hence (Uj(Aj iTl , Oi l „)) ne N is FOp° cal -convergent. □ □ 

Corollary 3. Let p > 1 and Zei (A n ) ng N &e a sequence of finite X-structures. 

Assume A n 6e i/ie disjoint union ofH n i (i £ N) where all but a finite number 
o/B n> j are empty. Let a n ^ = \B n _i\/\A n \. Assume further that: 

• for each i £ N, the limit on = lim„_j. 00 a n> i exists, 

• for each i £ N such that 014 ^ ; the sequence (B n) ,-)„ £ N is FO p ocal - 
convergent, 

• it holds 

on = i- 

»>i 

Then, the sequence (A„)„ s n is FO p ocal -convergent. 

Moreover, if Lj is a modeling FO p ocal -limit of (B„ j i)„ S N when on 7^ i/ien 



Ui(Li,Q:i) is a modeling FO l ° cal -limit of (A n )„ 
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Proof. This follows from Theorem 22 as A n = Uj(B„ ; j, a n ,i)- O □ 



Definition 15. A family of sequence (Ai „) nS N (i G /) of A-structures is uniformly 
elementarily convergent if, for every formula cf> G FOi(A) there is an integer N such 
that it holds 

Vi G I, Vn' > n > AT, (A i>n |= (3a;)0(a;)) => (A iiTi , |= (3x)0(x)). 

First notice that if a family (Aj in ) ne ^ (i G I) of sequences is uniformly elemen- 
tarily convergent, then each sequence (Aj in ) n6 N is elementarily convergent 

Lemma 31. Let I C TV, and let (Aj )n )„ e N (* G Z) &e sequences forming a uniformly 
elementarily convergent family. 

Then ({J ie j Aj jn ) ne jj is elementarily convergent. 

Moreover, if (Ai )T j)„ e N * s elementarily convergent to Aj i/ien (|J igJ Ai in )„ S N is 
elementarily convergent to Aj. 

Proof. Let A + be the signature A augmented by a binary relational symbol ro. 
Let 7i be the basic interpretation scheme of A + -structures in A-structures defining 



zu(x,y) for every x, y. Let A.f n — Zi(Aj jn ). According to Lemma 28 for every 

sentence 9 G FOo(A) there exist formulas ipi, . . . , ij) s G FO 1 ] 003,1 , an integer m, and a 
Boolean function F such that the property [J ieI A+ n \= is equivalent to 

F(Big mi ({i,A i<n h (3x)^(x)}),...,Big TO ,({i,A ilfl h = 1. 

According to the definition of a uniformly elementarily convergent family there is 
an integer N such that, for every 1 < j < s, the value Big mj . ({i, Aj ( „ |= (Ha;)^^)}) 
is a function of n, which is non-decreasing for n > N. It follows that this func- 
tion admits a limit for every 1 < j < s hence the exists an integer N' such that 
either \J ieI A+ n \= 9 holds for every n > N' or it holds for no n > N' . It fol- 
lows that (Ui£/ -^-^n)"6N is elementarily convergent. Thus (by means of the basic 
interpretation scheme deleting w) (Ui£i Aj jn ) ne N is elementarily convergent 

If I is finite, it is easily checked that if (Aj irj .) n gN is elementarily convergent to 
Aj then (U<cj Aj in ) ne N is elementarily convergent to [J ieI Aj. 

Otherwise, we can assume 7 = N. Following the same lines, it is easily checked 
that (UiLi Ai) ne N converges elementarily to ((J ieN Aj) ne pj. For i,n G N, let 
Bj,2n = Aj „ and Bj 2 n+i — Aj. As, for each i G N, Aj is an elementary limit of 
(Aj. rl )„ e pj it is easily checked that the family of the sequences (Bj.„)„ 6 N is uniformly 
elementarily convergent. It follows that (Uj gN Bj.„)„ e pj is elementarily convergent 
thus the elementary limit of ({J ieI Aj n )„ e pj and (U"=i Aj)„gN are ^ ne same, that 
isUe/A*. □ □ 

From Corollary [3] and Lemma [3T| then follows the next general result. 

Corollary 4. Let (A n )„ e j be a sequence of finite X-structures. 

Assume A n be the disjoint union 0/ B„ j (i G N) where all but a finite number 
o/B Mi j are empty. Let a n> i = \B n ^\/\A n \. Assume that: 

• for each igN, the limit at = lim„_ 5 . 00 a n ^ exists and it holds 



^2^ = 1, 



i>i 

• for each i G N such that on 7^ 0, the sequence (B nj j) ng N is F0 local - 
convergent, 

• the family {(B„.j)„ e N (i G N)} is uniformly elementarily convergent. 
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Then, the sequence (A„)„ s n is FO-convergent. 

Moreover, if Lj is a modeling YO-limit of (B n i ) ng pj when on ^ and an ele- 
mentary limit o/(B rai i) ne N when on = then ]jj(Li, CKj) is a modeling YO-limit of 

(A n ) nG N- 



9. Decomposing Sequences: the Comb Structure 

Definition 16. Let (A„)„ s n be a sequence of finite A-structures, having roeAas 
a component relation. In the following, we assume that w-spectra are extended to 
infinite sequences by adding zeros if necessary. 

• The sequence (A„) n6 N is w-race if Sp ro (A„) converges pointwise; 

• The limit w-spectrum of a w-nice sequence (A„) ne N is the pointwise limit 
of Sp ro (A„); 

• the tu-support is the set I of the indexes i for which the limit w-spectrum 
is non-zero; 

• the sequence has full w-spectrum if, for every index i not in the w-support, 
there is some N such that the ith value of Sp ro (A„) is zero for every n > N. 



As proved in Lemma 24 every F0 local -convergent sequence is w-nice. 



Lemma 32. Let (A n ) be a w-nice sequence of X- structures with empty w-support. 
Then the following conditions are equivalent: 

(1) the sequence (A„) is pQ local _ convergent; 

(2) the sequence (A„) is FO 1 ] 003,1 -convergent. 

Moreover, for every va-local formula (f> with p > 1 free variables it holds 

lim ((f>, A n ) = 0. 

n— foo 

Proof. F0 local -convergence obviously implies F0 1 1 ocal -convergence. So, assume that 
(Afl)neN is FO'^'-convergent, and let be a w-local first-order formula with p > 1 
free variables. For n € N, let ~B n .i (i € r„) denote the connected components of 
A n . As (A„) is w-nice and has empty w-support, there exists for every e > an 
integer N such that for n > N and every i £ T n it holds |-B n ,i| < e\A n \. Then, 
according to Corollary [2j for n > N 

< \p ( \ B n,i\ 

\p l-Bre.il p-1 _ p-1 

Hence (<j>,A n ) converges (to 0) as n grows to infinity. It follows that (A n )„ S N is 



F0 local -convergent, according to Lemma 



27 



□ □ 



Lemma 33. Let (A„) n6 N be an F0 local -convergent sequence of finite X-structures, 
with component relation vj and limit -co -spectrum (A^)^/. For n G N, let B„ i be 
the connected components of A n order in non- decreasing order (with B„ i empty if 
i is greater than the number of connected components of A n ). Let a < b be the first 
and last occurrence of X a = At, in the w-spectrum and let A' n be the union of all 
the ~Q n ,i for a < i < b. 

Then (A' n ) ne ft is FO-convergent if X a > and F0 local -convergent if X a = 0. 
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Assume moreover that (A„)„ e N has a modeling F0 local -limit L. Let L' be the 
union of the connected components L, of L with Ui,(Li) = X a . Equip AJ with the 
a-algebra El' which is the restriction of El to L' and the probability measure v-^* 
defined by v^{X) = ^(X)K(i') (for X € 

Then L' is a modeling FO-limit of (A' n ) ne fj if X a > and a modeling po local - 
limit of (A^)„ eN if X a = 0. 

Proof. Extend the sequence A to the null index by denning Ao = 2. Let r — 
min(A a _i/A Q , Xb/Xt+i) (if Xb+i = simply define r = A a _i/A a ). Notice that r > 1. 
Let be a w- local formula with p free variables. According to Corollary [2] it holds 



In particular, it holds 



Let a > 1/(1 - rP). Define 



l-Bn,' 



From the definition of r it follows that for each n € N, u; n j > iu n) j if i < a and 
j > a or i < b and j > fe. Let cr S be such that a n ^ — w„,<x(i) is non-increasing. 
It holds 

(t>\A„) + (0,A„). 



Hence 



lim a p 4 



exists. According to Lemma 
exists. Moreover, as cr globa 



23 it follows that for every i £ N the limit hin^^oo a n ^ 



ly preserves the set {a, . . . , b} it follows that the limit 



, 1 i-Ef^r)V + (0,B„,)) 



|A r , 

exists. As for every i £ {a, . . . , 6} it holds lim n _).oo |-B nj ,-|/|A„| = A a and as 
= Y, b i= a (\Bn,i\/\An\) p (<i>,B n!i ) we deduce 

lim (cj), A' n ) = d — (b — a+ l)a. 



Hence lim„_ > . oo (0, A' n ) exists for every tu-local formula and, according to Lemma 27 
the sequence (A^)„ e pj is F0 local -convergent. 

Assume A > 0. Let N = b — a + 1. To each sentence 9 we associate the formula 
9 € FO^ cal that asserts that the substructure induced by the closed neighborhood 
of xi, . . . , Xn satisfies 9 and that xi, . . . , xm are pairwise distinct and non-adjacent. 
For sufficiently large n, the structure A^ has exactly N connected components. It 
is easily checked that if A' n does not satisfy 9 then (9, A' n ) = 0, although if A^ 
does not satisfy 9 then 



N 



hence (9, A' n ) > (2A) N for all sufficiently large n. As (9, A' n ) converges for 
every sentence 9, we deduce that the sequence (AJJ„ s n is elementarily convergent. 



According to Theorem 11 the sequence (A' n ) n ^ is thus FO-convergent. 
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Now assume that (A„) n6 j( has a modeling F0 local -limit L. First note that Lj 
being an equivalence class of w it holds Li £ Xl, hence L' £ Sl and isl,(L') is well 
defined. For every w- local formula <fi £ FO p (A) it holds, according to Lemma 25 

b 

(0,1/) (L 4 ) P (0,L*) 

i—a 



We deduce that 

(0,L') = lim {4>,A' n ). 

n— f Co 

According to Lemma [27j it follows that the same equality holds for every <fi £ 
F0 local (A) hence V is a modeling F0 local -limit of the sequence (A'J„ £N . 

As above, for A a > 0, if L' is a modeling F0 local -limit of (AJJ„ s n then it is a 
modeling FO-limit. 

□ □ 

Lemma 34. Let (A„)„ s n be an FO-convergent sequence of finite X-structures, with 
component relation vj . Assume all the A„ have at most k connected components. 
Denote by B ni i, . . . , B n! fc these components (and additional empty X-structures if 
necessary). 

Assume that for each 1 < i < k it holds lim,,^^ |S n ^|/|A n | = l/k. 
Then there exists a sequence (er„) n6 N of permutations of [k] such that for each 
1 < i < k the sequence (B^^^jngg is FO-convergent. 

Proof. To a formula 4> € FO p (A) we associate the w-local formula (f> £ FO p ocal (A) 
asserting that all the free variables are zn-adjacent and that their closed neighbor- 
hood (that is their connected component) satisfies (j>. Then essentially the same 
proof as above allows to refine A„ into sequences such that (</>, A' n t ) is constant 
on the connected components of each of the A^. Considering formulas allowing to 
split at least one of the sequences, we repeat this process (at most k — 1 times) 
until each A! n i contains equivalent connected components. Then, A^ i can be split 
into connected components in an arbitrary order, thus obtaining the sequences 
B n>i . □ □ 

So we have proved that a FO-convergent can be decomposed by isolines of the 
ccj-spectrum. In the next sections, we shall investigate how to refine further. 

9.1. Sequences with Finite Spectrum. For every w-nice sequence (A„)„ e N 
with finite support /, we define the residue R„ of A„ as the union of the connected 
components B„ j of A„ such that i ^ I. 

When one considers an F0 local -convergent sequence (A n ) with a finite support 
then the sequence of the residues forms a sequence which is either F0 local -convergent 
or "negligible" in the sense that lim^oo |i?„|/|^4 n | = 0. This is formulated as 
follows: 

Lemma 35. Let (A n )„ e pj be a sequence of X-structures with component relation 
zu. For each n £ N and i £ N, let B„ i be the i-th largest connected component of 
A n . 

Assume that (A n ) n£ n is FO loc&l -convergent and has finite spectrum (Xi)i e i. Let 
R„ be the residue of A n . 

Then X' = lim, woo |i?„|/|A„| exists and either A' = or (R„)„ £ n is F0 local - 
convergent. 
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Proof. Clearly, A' = 1 — ^ A^. Assume A' > 0. First notice that for every e > 
there exists N such that for every i > N, the A-structure R ra has no connected 
component of size at least e/2A'|A n | and R„ has order at least A' /2\A n \. Hence, for 
every i > N, the A-structure R„ has no connected component of size at least el-Rn.1. 



According to Lemma 32 proving that (R„) n(E N is F0 local -convergent reduces to 
proving that (R n )„ S N is FO^^'-convergent. 

Let cj) G FO 1 ] 00 ^. We group the A-structures B rv ; (for i 6 /) by values of Ai as 
A' n i, . . . , A' n . Denote by Cj the common value of Aj for the connected components 
B n! i in A' n y According to Corollary [2] it holds (as cf> is clearly ro-local): 



9 



A' „•) + TT^l-(d>, R») 



£j \A n \ ^ \A 



According to Lemma 33 each sequence (A' n ? ) n( =N is FO-convergent. Hence the 



"J 

limit lim„_ > . 00 ((/), R„) exists and we have 

9 



If 

lim (cj), R„) = — lim ((f), A„) - V cj lim (cj), A' n 

i.—±m A' \ •{!. — ^rxn ' * 7i. — Vnci 



z\ \ n— >-oo * * n— *-oo ,J 

3=1 

It follows that the sequence (R„)„ e N is F0 local -convergent. □ □ 

The following result finally determines the structure of converging sequences 
of (disconnected) A-structures with finite support. This structure is called comb 
structure, see Fig [6] 

Theorem 23 (Comb structure for A-structure sequences with finite spectrum). Let 
(A n )„gN be an F0 local -convergent sequence of finite X-structures with component 
relation w and finite spectrum (Ai)i 6 /. Let R„ be the residue of A n . 

Then there exists, for each n S N, a permutation /„:/—>/ such that it holds 

• lim„_>. 00 maxj^i |.B n)i |/|A n | = 0; 

• lim^oo |i? n |/|A„| exists; 

• for every i € L, the sequence (B n j n ti\) ne ^ is FO-convergent and 
linin-^oo |B nj / n (i)|/|A„| = A,; 

• either lim„_ i . 00 |i? n |/|yl„| = 0, or the sequence (R n ) n£ N * s F0 local - 
convergent. 

Moreover, if (A„)„ e pj is FO-convergent then (R rt ) n6 N is elementary- convergent. 



Proof. This lemma is a direct consequence of Lemmas [33] [34] and [35] except that we 
still have to prove FO-convergence of (R n )„ £ N in the case where (A„)„ £ n is FO- 
convergent. As / is finite, the elementary convergence of (R„)„ e N easily follows 
from the one of (A n ) and the one of the (H n j n (i)) for i E I. □ □ 

9.2. Sequences with Infinite Spectrum. Let (A„)„ s n be a ro-nice sequence 
with infinite spectrum (and support I = N). In such a case, the notion of a residue 
becomes more tricky and will need some technical definitions. Before this, let us 
take the time to give an example illustrating the difficulty of the determination of 
the residue R„ in the comb structure of sequences with infinite spectrum. 
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Gi 
G 2 
G 3 



G n 



Al 



Figure 6. Illustration of the Comb structure for sequences with 
finite support 



Example 9. Consider the sequence (G„) nS N where G n is the union of 2™ stars 
12,1,1, . . . , -ff n ,2», where the i-th star if n)i has order 2 2 "(2~ l -|-2~ Tl )/2. Then it holds 

A,= lim \H n>i \/\G n \ = 2-( l+1 ) 

hence A; = 1/2 thus the residue asymptotically should contain half of the ver- 
tices of G n \ An FO-limit of this sequence is shown Fig. [7j 

This example is not isolated. In fact it is quite frequent in many of its variants. 
To decompose such examples we need a convenient separation. This is provided by 
the notion of clip. 

Definition 17. • A clip of a tu-nice sequence (A„) nG N with support N is a 

non-decreasing function C : N — > N such that lim„_ i . 00 C(n) — oo and 

C(n) 



Vn' > n 



B 



n' ,i | 



Ar. 



-A, 



< E * 

i>C{n) 



• The residue R„ of A„ with respect to a clip C{n) is the disjoint union of 
the B rlj i for i > C(n). 

Proposition 4. Every vo-nice sequence (A„) nS N with infinite support has a clip 
Co, which is defined by 



, M 
C (n) = supi M, (Vn' > n) ^ 



\B 



n ,i | 



a, 



i>M 



Moreover, lim„_j. Co(n) — oo and a non decreasing function C is a clip of (A„)„ e p 
if and only if C < Co and lim,^ C (n) = oo . 
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Figure 7. An FO-local limit. On the left side, each rectangle 
correspond to a star with the upper left point as its center; on the 
right side, each vertical line is a star with the upper point as its 
center. 



\a„.\ A < 



is 



Proof. Indeed, for each n € N, the value zi{M) — sup„, >n ^- =1 

non-decreasing function of C with Z;(0) = 0, and z r {M) = ^2 i>M A, is a decreasing 
function of C with z r (0) = J^i Ai > hence Cq is well defined. Moreover, for every 
integer M, let a = J2i>M ^ > 0- Then, as lim„_ i . 00 | S n '^ | / 1^4„/ 1 = A* there exists N 
such that for every n' > N and every 1 < i < M it holds ||.Bn',i|/|-<4.ri'| — A» j < a/M 
thus for every n' > N it holds 



E 

i=l 



I A.' 



A, 



< a = X * 



i>M 



It follows that Cq(N) > M. Hence lim n _ J . 00 Co(n) — oo. 

That a non decreasing function C is a clip of (A„)„ g ^ if and only if C < Cq and 
rim„_> C(n) = oo follows directly from the definition. □ □ 

Lemma 36. Let (A n ) n6 pf be a w-nice sequence with support N, and let C be a clip 
°f (A„)„ e N- 

Then the limit A' = lim„_i. 00 1^4 exists and A' = 1 — A^. 
Proof. As C is a clip, it holds for every n E N 

C(n) 

E ^E^E^ 

i i>C(n) i=l 1 n| i 

Also, for every e > there exists n such that | ^« — Si A<| < e, that is: 

J2i>c(n) *i < e - It; follows that 

lim >^ . = ; Aj. 

, woo \An\ ^ 

I— 1 i 

Hence the limit A' = lim n _ ! . 00 j^j exists and A' = 1 — A^. □ □ 
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Lemma 37. Let (A n )„ £ N be a sequence of X-structures with component relation 
zd. For each n € N and i £ N, let B n) , be the i-th largest connected component of 
A„ (if i is at most equal to the number of connected components of A n , the empty 
X-structure otherwise). 

Assume that (A„)„ e N is FO- convergent. 

Let C : N — > N be a clip o/(A„)„ e pj, and let R„ be the residue of A„ with respect 
to C. 



Let A' = linin^oo |i? n |/|^4„|. Then either X 1 — or(R„)„ £ N is FO 



local 



convergent. 



Proof. According to Lemma 36 



_ lim^oo |-R„|/|A„| exists and A' = 1 - J2i As- 
sume A' > 0. First notice that for every e > there exists N such that for every 
i > N, the A-structure R„ has no connected component of size at least e/2A'|A„| 
and R„ has order at least A'/2|A„|. Hence, for every i > N, the A-structure R„ has 
no connected component of size at least e|i?„|. According to Lemma 32 proving 
that (R„)„ eN is F0 local -convergent reduces to proving that (R„)„ eN is FO 1 ] 008,1 - 
convergent. 

Let (f> € FOi ocal (thus (f> is w- local). Let e > 0. There exists k € N such that 
J2i<k Ai > 1 — A' — e/3 and such that A^+i < A&. We group the A-structures B„ ;i 
(for 1 < i < k) by values of Ai as A' n l , . . . , A' n q . Denote by cj the common value 
of Xi for the connected components B„ ^ in A.' n j- According to Lemma 
sequence (A^ j)„ S N is FO-convergent. Define 



33 



Mi = lim (<f>> A' i). 

n— >oo 

There exists TV such that for every n > N it holds 

|(0,A: M )-^| < e /3. 

According to Corollary [2] it holds, for every n > N: 
\B n ,i 



i=l 



, B r 



V 14 



^ 14 

i=fc+i 1 



i,B nii ) 



14 

i>C(n) 1 T ' 



A' 



\B„.i 



C(n) 



141 



, Rn) 



Thus we have 



9 

A'(</>, R„) - ((0, A„) - ^ c iMi) 



<£k0,a: m )- 



(=i 

< e. 



C(n) 
i=fe+l 



l^nl + lliZnl/IA, 



It follows that lim„_ i . oo (0, R„) exists. By sorting the C{n) first connected com- 
ponents of each A„ according to both Aj and Lemma [34] we obtain the following 
expression for the limit: 



lim ( 

n— > oo 



-^-( lim (<p,A n ) - V* Xi lim (0,B ni )). 

A n— foo ^ — • n— foo 



KC 



□ 



□ 
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Theorem 24 (Comb structure for A-structure sequences with infinite spectrum 
(local convergence)). Let (A„) ng jj be an FO oca -convergent sequence of finite X- 
structures with component relation w , support N, and spectrum (A^gN- Let C : 
N — > N be a clip of (A„)„ e pj, and let R„ be the residue of A„ with respect to C. 

Then there exists, for each n G N, a permutation f n : [C'(n)] — > [C(n)] such that, 
extending f n to N by putting f(i) to be the identity for i > C(n), it holds 

• lim^oo max i>c( „) |B nii |/|^4 n | = 0; 

• X' =]hn n ^. 00 \R n \/\A n \ exists; 

• for every i € N, (B n j n ^) ne m is FO -convergent; 

• either A' = or the sequence (R n )„gN is po local -convergent. 



Proof. This lemma is a direct consequence of the previous lemmas. 



□ 



□ 



Gi 
G 2 
G, 



G n 



H n ,i 



Hn,C(n) Rn 



Ai A 2 A; 1 — JZi 



Figure 8. Illustration of the Comb structure theorem 

We shall now extend the Comb structure theorem to full FO-convergence. Op- 
posite to the case of a finite tn-spectrum, the elementary convergence aspects will 
be non trivial and will require a careful choice of a clip for the sequence. 

Lemma 38. Let (A n ) ne m be an F0 local -convergent sequence of finite X-structures 
with component relation w, such that lim„_j. 00 \A n \ — oo. Let B„^ be the connected 
components of A n . Assume that the connected components with same Xi have 



been reshuffled according to Lemma 34, so that (B n .i)ieti is FO-convergent for each 
i£N. _ 

For i € N, let be an elementary limit of (H n _i) nl =iq. Then there exists a 
clip C such that the sequence (R n )„ e N of the residues is elementarily convergent. 
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Moreover, i/R is an elementary limit o/(R„)„ e N ; then [J i U R is an elementary 
limit of (A„)„ eN . 

Let B^ i be either B rli i ifC(n) > i or the empty X-structure if C{n) < i. Then the 
family consisting in the sequences (B^J^n (i G N) and of the sequence (R„)„ e N 
is uniformly elementarily convergent. 

Proof. Let A be an elementary limit of (A„) n6 N. 

For 9 G FO^ cal and to G N we denote by 9^ the sentence 

(m 
f\ -m(xi,Xj) A f\6{ Xl 
l<i<j<m i—1 

According to Theorem [TUJ elementary convergence of a sequence of A-structures 
with component relation vj can be checked by considering sentences of the form 
00) fo r G FOi ^ 1 and k G N. 

Note that for every k < k' and every A-structure A, if it holds A |= 9^ k ) then it 
holds A \= 9 {k \ Define 

M{9) — sup{/c G N, A^9 (k) } 
(1(6) = {t G N, §J (= (3_)0(a;)}. 
Note that obviously < M(0). 

For r G N, let #i, . . . , #F(r) be an enumeration of the local first-order formulas 
with a single free variable with quantifier rank at most r (up to logical equivalence). 
Define 

A(r) = max(r, max maxQ(9 a )). 

a<F(r) 

Let 

C (n) = sup(^, (W > n) £ - A, < ]T A,) 

be the standard (maximal) clip on (A„)„ s n (see Proposition |4| . 
Let -B(r) be the minimum integer such that 

(1) it holds Co{B(r)) > A(r) (note that lim^oo Co (n) = oo, according to 
Proposition El); 

(2) for every n > B(r),a < F(r) and every k < r it holds A n (= #i if and 
only if M(9 a ) > k (note that this holds for sufficiently large n as A is an 
elementary limit of (A„)„ eN ); 

(3) for every i < A(r) and a < F(r) it holds 

B„, h= (3a)0«(aO B~h (3z)0«O)- 

(note that this holds for sufficiently large n as B^ is an elementary limit of 
(B ni i)„ e N an d as we consider only finitely many values of i); 
we define the non-decreasing function C : N — > N by 

C(n) = max{^4(r) : B(r) < n}. 

As limj._j.oo A(r) = oo and as Co(B(r)) > A(r) it holds lim r _ ) . 00 B(r) — oo. More- 
over, for every r G N it holds Co(B(r)) > A(r) hence Co(n) > C(n). According to 
Proposition |4j it follows that the function C is a clip on (A n ) ne ^. 

Let (R„)„ e N be the resiude of (A„)„ e N with respect to the clip C, and let ~B' n i 
be defined as B„ , if i < C(n) and the empty A-structure otherwise. Then it is 
immediate from the definition of the clip C that the family {(B' n j) n£ N : i G N} 



is uniformly elementarily convergent. Using Lemma 28 it is also easily checked 



that the residue (R„) ne N of (A„) ne N with respect to the clip C is elementarily 
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convergent and thus, that the family {(B' ni ) ne ^ : ieN}U {(R,,),,^} is uniformly 
elementarily convergent. □ □ 

The extension of the Comb structure theorem now follows directly. 

Theorem 25 (Comb structure for A-structure sequences with infinite spectrum). 
Let (A„) nG N be an FO- convergent sequence of finite X-structures with component 
relation w and infinite spectrum (Aj)j £ N. 

Then there exists a clip C : N — > N with residue R„ and, for each n e N, a 
permutation f n : [C(n)] — > [C(n)] such that, extending f n to N by putting f(i) to 
be the identity for i > C(n), and letting B' n i be either B„j n (,) if C{n) > i or the 
empty X-structure if C{n) < i, it holds: 

• A„ = R„ U U;eN B «,i>' 

• hm^oo max !>c(n) |B^.|/|A„| = 0; 

• lim^co |i?„|/|A„| exists; 

• for every i £ M, (B' n JneN is FO- convergent; 

• either limn-too \R n \/\A n \ = and (R„)„ e N is elementarily convergent, or 
the sequence (R„)„ £ n is FO- convergent; 

• the family {(B^ JngN : « G N} U {(R n )neN} is uniformly elementarily con- 
vergent. 

□ 

10. Limit of Colored Rooted Trees with Bounded Height 

In this section we explicitly define modeling FO-limits for FO-convergent se- 
quences of colored rooted trees with bounded height. 

For the sake of simplicity, we first sketch our method for FO-convergent sequences 
of colored rooted trees with bounded height. 

We consider two signatures: 

(1) the signature A consisting in a binary relation <~ (adjacency), a unary rela- 
tion R (property of being a root), and c unary relations C'i (the coloring). 
Colored rooted trees will be encoded as A-structures, and the class of col- 
ored rooted trees with height at most h will be denoted by . 

(2) the signature A + , which is the signature A augmented by a new unary 
relation P. The signature A + is used to encode colored rooted forests with 
a principal connected component, whose root will be marked by relation P 
instead of R. The class of colored rooted forests with a principal connected 
component and height at most h will be denoted by J 7 ^ . 

Classes and J 7 ^ obviously form basic elementary classes. Thus they can be 
axiomatized by a single axioms. These axioms are denoted and rj^ . For integer 
p > 0, we further introduce a short notation for the Stone spaces associated to the 
Lindenbaum-Tarski algebras of formulas on jA'O and with p free variables 

included in {xi, . . . , x p }: 

^ = S(B(FO p (X), V ^)) 
di h) =S(B(FO p (X+), v { F h) )). 
We consider three basic interpretation schemes: 

(1) ly_>F is a basic interpretation scheme of A + -structures in A-structures, 
which maps a colored rooted tree with height h into a colored rooted forest 
with height h — 1 (the trees rooted at the sons of the former root) and a 
single vertex rooted principal component (the former root); 
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(2) I f^y is a basic interpretation scheme of A-structures in A + -structures, 
which maps a colored rooted forest with height h into a colored rooted 
tree by making each non principal root a son of the principal root; 

(3) I r-^-p is a basic interpretation scheme of A-structures in A + -structures, 
which maps a colored rooted tree into the "identical" colored rooted forest 
having a single component. (Roughly speaking, the relation R becomes the 
relation P.) 

Let (Y„)„ s n be an FO-convergent sequence of finite rooted colored trees such 
that lim„_>. 00 \ Y n \ = oo. 

According to the Comb Structure Theorem, there exists a countable set (Y n ,i)ne^ 
of FO-convergent sequences of colored rooted trees and an FO-convergent sequence 
(R n )„ e N of special colored rooted forests (as the isolated principal root obviously 
belongs to R„) forming a uniformly convergent family of sequences, such that 
Iy^f(Y„) = R„ U Uigj Y nyi . 

If the limit spectrum of (ly_j,j?(Y„)) ne N is empty (i.e. I — 0), the sequence 
(Y„)„ e N of colored rooted trees is called residual, and we prove directly that a 
residual sequence of colored rooted trees admit a modeling FO- limit, which is ob- 
tained by equipping a connected component of a universal relational sample space 
Y/j with a suitable probability measure. 

Otherwise, we proceed by induction over the height bound h. Denote by (Aj)jg/ 
the limit spectrum of (7y_>.i?(Y n )) ra £N, let Ao = 1 — J^jp/Aj, and let Y„ o = 
\r-^p ° lj?->y(Rn)- As (lF^y(Rn))neN is residual, (Y„ !0 ) n eN has a modeling 
FO-limit Yq. By induction, each (Y n i ) ng N has a modeling FO-limit Yj. As 
Y„ = lF^y(Uie/u{o} Y n ,i)i we deduce (using uniform elementary convergence) 
that (Y„)„ eN has modeling FO-limit l*M-y(Lk 6 /u{o}(Y<, A*)). 

This finishes the outline of our construction. Now we provide details. 

10.1. Preliminary Observations. We take some time for some preliminary ob- 
servations on the logic structure of rooted colored trees with bounded height, that 
will be of great help in our developments. These observations will be an occa- 
sion to see arguments based on Ehrenfeucht-Frai'sse games and strategy stealing. 



(Definitions of = n and Ehrenfeucht-Frai'sse games were recalled in Section 5.1 ) 

For a rooted colored tree Y and a vertex x € Y, we denote Y(x) the subtree of 
Y rooted at x, and by Y \ Y(x) the rooted tree obtained from Y by removing all 
the vertices in Y(s). 

Lemma 39. Let Y, Y' be colored rooted trees with height h, let s, s' be sons of the 
roots o/Y and~Y', respectively. 

Let neH. IfY(s) =" Y'(s') and Y \ Y(s) = n Y' \ Y'(s'), then Y = n Y'. 

Proof. Assume Y(s) = n Y'(s') and Y\Y(s) = n Y'\Y'(s'). In order to prove Y =" 
Y' we play an n-steps Ehrenfeucht-Fraisse-game EFo on Y and Y' as Duplicator. 
Our strategy will be based on two auxiliary n-steps Ehrenfeucht-Fraisse-games, EFi 
and EF2, on Y(s) and Y'(s') and on Y\ Y(s) and Y'\ Y'(s'), respectively, against 
Duplicators following a winning strategy. Each time Spoiler selects a vertex in game 
EF , we play the same vertex in the game EFx or EF 2 (depending on the tree the 
vertex belongs to), then we mimic the selection of the Duplicator of this game, it 
is easily checked that this strategy is a winning strategy. □ □ 

Lemma 40. Let Y, Y' be colored rooted trees with height h, let s, s' be sons of the 
roots o/Y andY', respectively. 

Let neN. If Y = n + h Y' and Y(s) = n Y'(s'), then Y \ Y(s) =™ Y' \ Y'(s') 

Proof. Assume Y = n+h Y' and Y(s) = n Y'(s')- 
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We first play (as Spoiler) s in Y then s' in Y' . Let t' and t be the corresponding 
plays of Duplicator. Then the further n steps of the game have to map vertices in 
Y(s), Y(t), Y\(Y(s)UY(t)) to Y'(i'), Y'(s'), Y'\(Y'(i')UY'(s')) (and converse), 
for otherwise h — 2 steps would allow Spoiler to win the game. Also, by restricting 
our play to one of these pairs of trees, we deduce Y(s) =™ Y'(t'), Y(t) =" Y'(s'), 
and Y \ (Y(s) U Y(t)) = n Y \ (Y'(s') U Y'(t')). As Y'(s') =" Y(s) it follows 

Y(t) =" Y'(s') = n Y(s) ee™ Y'(t'). 



Hence, according to LemmajMJ as Y \ (Y(s) U Y(i)) = (Y \ Y(s)) \ Y(i) and Y' \ 
(Y'(s')UY'(t')) = (Y'\Y'(s'))\Y'(f), we deduce Y\Y(s) = n Y'\Y'(s'). □ □ 

Lemma 41. Let X be a signature of colored rooted tree and let A + be the signature 
X augmented by a unary symbol M (interpreted as a marking). 

Let Y, Y' be colored rooted trees with height at most h with signature X + , such 
that Y (resp. Y' ) has exactly one marked vertex m (resp. m!). Assume that 
both m and m! have height t > 1 (in Y and Y' , respectively). Let s (resp. s' ) 
be the ancestor of m (resp. ml ) at height 2. Let Unmark be the interpretation of 
X-structures in A + -structures consisting in forgetting M and let n€N. 

//Unmark(Y) = n+h Unmark(Y') and Y(s) ee™ Y'(s'), then Y = n Y' . 

Proof. Assume Unmark(Y) = n+h Unmark(Y') and Y(s) ee™ Y'(s'). Then it holds 
Unmark(Y(s)) ee™ Unmark(Y'(s')) thus, according to Lemma [40| 

Y \ Y(s) = Unmark(Y) \ Unmark(Y(s)) 

ee™ Unmark(Y') \ Unmark(Y'(s')) = Y' \ Y'(s'). 

Hence, according to Lemma [39], it holds Y ee™ Y'. □ □ 

The next lemma states that the properties of a colored rooted trees with a 
distinguished vertex v can be retrieved from the properties of the subtree rooted at 
v, the subtree rooted at the father of v, etc. (see Fig. [9]). 

Lemma 42. Let Y, Y' be colored rooted trees with height at most h, Vt € Y and 
v' t 6 Y' be vertices with height t. For 1 < i < t, let Vi (resp. v[) be the ancestor of 
v t (resp. ofv'f) at height i. 

Then for every integer n it holds 

(VI <i<t) Y(vi) = n + h + 1 - i Y'(?4) (Y,v t )= n (Y',v' t ) 

(Y,v t ) = n +(t-i)h (Y\ v ' t ) (VI < i < t) Y{ Vl ) = n +{t-*)h Y '(v'.) 

Proof. We proceed by induction over t. If t = 1, then the statement obviously 
holds. So, assume t > 1 and that the statement holds for t — 1. 

Let A be the signature of Y and Y', let A + be the signature obtained by adding 
to A a unary symbol M (interpreted as marking), and let Y + (resp. Y^_) be the 
rooted colored trees (with signature A + ) obtained from Y (resp. Y') by marking 
v t (resp. v' t ). 

Assume (VI < i < t) Y(v,) =n+h+i-i Y'(^). By induction, (V2 < i < 
t) Y(vi) =«+(fc-i)+i-(i-i) y'(^) implies (Y(v 2 ), v t ) = n (Y'(v' 2 ),v' t ), that is Y+(v 2 ) 
Y' + (v' 2 ). As Y ee"+' 1 Y', it follows from Lemma 
(Y, Vt) ee" (Y',v' t ). 

Conversely, if (Y,v t ) = n +(t-i)h (Y',v' t ) (i.e. Y+ =n+(t-i)h Y ' + ) an repeated 
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that Y + ee™ Y^, that is: 



application of Lemma 40 gives Y + (vi) ="+(* V h Y' + (vi)' hence (by forgetting the 



marking) Y( Vl ) ^(t^ Y'(vi)'. □ □ 

This lemma allows to encode the complete theory of a colored rooted tree Y 
with height at most h and a single special vertex v as a tuple of complete theories 
of colored rooted trees with height at most h. 
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10.2. The universal relational sample space Y^. The aim of this section is 
to construct a rooted colored forest on a standard Borel space that is residual- 
universal, in the sense that every residual sequence of colored rooted trees will have 
a modeling FO-limit obtained by assigning an adapted probability measure to one 
of the connected components of Y/,. 

For theories T,T' € 2)^ ) (recall that 2) ' l) = S(B(FO (A), we define 
w(T,T') > k if and only if there exists a model Y of T, such that the root of Y 
has k (distinct) sons v%,... ,v k with Th(Y(«j)) = T', 

For z = (zx, . . . , z a ) £ N a define the subset F z of (Z) { h) ) a+1 by 

F z = {(Jo, . . . ,T a ) : w(Ti-i,Ti) = Zi}. 

For t e M, define 



For z = (zi. 




^ = 2J ' l) W l+J (T, xX a ). 



Note that V h is a subset of |+I J=1 (2) ^ x [0, l]*" 1 . We define the cr-algebra E h 
as the trace on Vu of the Borel cr-algebra of l+lf =1 (?)o C '' 1 ) % X [0, 1] 4_1 . 

Definition 18. The universal forest Y^ has vertex set Vh, set of roots %)q 1 \ and 
edges 

{((T ,T U . . .,T a ), (a u . . . ,a a )), ((Tq, T[, . . . ,T 6 '), K, . . .,a' 6 ))} 
where \a — b\ = 1, To = Tg, and for every 1 < i < min(a, b) it holds T = T/ and 
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The remaining of this section will be devoted to the proof of Lemma 44 which 
states that Y/, is a relational sample space. In order to prove this result, we shall 
need a preliminary lemma, which expresses that the property of a tuple of vertices 
in a colored rooted tree with bounded height is completely determined by the 
individual properties of the vertices in the tuple and the heights of the lowest 
common ancestors of every pair of vertices in the tuples. 

Lemma 43. Fix rooted trees Y, Y' € y^ h \ Let u\,.. . ,u p be p vertices ofY, let 
u'i, . . . , u' p be p vertices of Y' , and let neH. 

Assume that for every 1 < i < p it holds (Y, m) ~ n+h (Y', u'J and that for every 
1 < i,j < P the height of u, A Uj in Y is the same as the height of u' i A u'j in Y' 
(where u A v denotes the lowest common ancestor of u and v). 

Then (Y, m, . . . , u p ) =™ (Y', u[, . . . ,u' p ). 

Proof. In the proof we consider p + 1 simultaneous Ehrenfeucht-Frai'sse games (see 
Fig.lTol). 




Figure 10. A winning strategy for 

EF((Y, u±, . . . , Up), (Y', u' x , . . . , tip), n) using p auxiliary games 

EF((y,u i ),(y',tO,n + /i). 



Consider an n-step Ehrenfeucht-Frai'sse EF((Y, u\,..., u p ), (Y', u^, . . . , u' p ), n) 
on (Y, m, . . . , u p ) and (Y', u[, . . . , u' p ). We build a strategy for Duplicator by 
considering p auxiliary Ehrenfeucht-Frai'sse games EF((Y, u,), (Y',u' i ),n + h) on 
(Y,Ui) and (Y',uQ (for 1 < i < p) where we play the role of Spoiler against 
Duplicators having a winning strategy for n + h steps games. 

For every vertex v £ Y (resp. v' € Y') let p{v) (resp. p'{v)) be the maximum 
ancestor of v (in the sense of the furthest from the root) such that p(v) < m (resp. 
p'(v) < u'j) for some 1 < i < p. We partition Y and Y' as follows: for every vertex 
v € Y (resp. v' € Y') we put v € Vi (resp. v € V() if i it the minimum integer 
such that p(v) < Ui (resp. such that p'(v) < u^), see Fig 11 

Note that each Vi (resp. V- induces a connected subgraph of Y (resp. of Y'). 

Assume that at round j < n, Spoiler plays a vertex v € (Y, u\, . . . , u p ) (resp. a 
vertex v' S (Y', u[, . . . , u' p )). 

If v £ Vi (resp. v' € V-) for some 1 < i < p then we play v (resp. v') on (Y, u,) 
(resp. (Y', u^). We play Duplicator on (Y' ,u[, . . . , u' ) (resp. on (Y, u\, ■ ■ ■ , u p )) 
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Figure 11. The partition (Vi, V 2 , V 3 , V4) of Y induced by (ui,u 2 ,u 3 , u A ). 

with the same move as our Duplicator opponent did on (Y',itj) (resp. on (Y,%)). 
If all the Duplicators' are not form a coherent then it is easily checked that h 
additional moves (at most) are sufficient for at least one of the Spoilers to win one 
of the p games, contradicting the hypothesis of p winning strategies for Duplicators. 
It follows that (Y, Ui,..., u p ) =" (Y', u[, . . . ,u' p ). □ □ 

Lemma 44. The rooted colored forest Y/, (equipped with the a -algebra Hh) is a 
relational sample space. 



Proof. Let ip g FO p and 

n„(Y h ) = {(«!,..., v p )eV£: Y h ^ip( Vl ,...,v p )}. 

Let n = qrank(ip). We partition V/j into equivalence classes modulo = n+h , which 
we denote C\, . . . , C'n- 

Let ii, . . . , i p £ [N] and, for 1 < j < p, let Vj and v'^ belong to Ci j . 

According to Lemma |43j if the heights of the lowest common ancestors of the 
pairs in (y\, . . . , v p ) coincide with the heights of the lowest common ancestors of 
the pairs in (v[, . . . , v' p ) then it holds 

(Y h ,v x ,...,v p )= n (Y h , v[, ■ ■ ■ ,v' p ) 

thus (ui,. ..,v p )e fl v (Y h ) if and only if (v[, . .. ,v' p ) € rt v {Y h ). 

It follows from Lemma 42 (and the definition of and E^) that each Cj is 



measurable. According to Lemma [42] and the encoding of the vertices of Vh, the 
conditions on the heights of lowest common ancestors rewrite as equalities and 
inequalities of coordinates. It follows that fl v (Yh) is measurable. □ □ 

10.3. The Modeling FO-limit of Residual Sequences. We start by a formal 
definition of residual sequences of colored rooted trees. 

Definition 19. Let (Y„)„ s n be a sequence of finite colored rooted trees, let N n be 
the set of all sons of the root of Y n , and let Y n (v) denote (for v € Y n ) the subtree 
of Y„ rooted at v. 

The sequence (Y„) n£ N is residual if 

r M n 

limsup max — — = (J. 

n->oo v£N n Y„, 
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We extend this definition to single infinite modelings. 

Definition 20. A modeling colored rooted tree Y with height at most h is residual 
if, denoting by N the neighbour set of the root, it holds 

su P z/y(Y(u)) = 0. 

Note that the above definition makes sense as belonging to a same Y(u) (for 
some v £ N) is first-order definable hence, as Y is a relational sample space, each 
Y(i>) is E^-measurable. 

We first prove that it is sufficient for a modeling colored rooted tree to be a 
modeling FO-limit of a residual sequence (Y n )„ S N of rooted colored trees with 
bounded height, it is sufficient that it is a modeling FOi-limit of the sequence. 

Lemma 45. Assume (Y„)„ 6 n is a residualFOi- convergent sequence of 'finite rooted 
colored trees with bounded height with residual modeling FOi-limit Y. 
Then (Y„) nS N is FO-convergent and has modeling FO-limit Y. 

Proof. Let febea bound on the height of the rooted trees Y„. Let F„ = Iy^j?(Y„). 
Let w be the formula asserting dist(xi, x<z) < 2h. Then F„ |= w(u,v) holds if 
and only if u and v belong to a same connected component of F n . According to 
Lemma 32 we get that (F„)„ e N is F0 local convergent. As it is also FOo-convergent, 
it is FO convergent (according to Theorem 11). As Y n = 7f_>.y(F„), we deduce 
that (Y„)„ eN is FO-convergent. 

and 



That Y is a modeling FO-limit of (Y n ) n6 N then follows from Lemma 
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Lemma [25] □ □ 

Now we have to relate FOi properties to our encoding of Vh, in order to transfer 
the measure fi we obtained in Theorem [7] on S(B(FOi)) to the relational sample 
space formed by the connected component of that is an elementary limit of the 
considered residual sequence. To achieve this, we need some preparatory technical 
lemmas. 

Let A* denote the signature obtained from A by adding a new unary relation S 
(marking a special vertex). Let 0, be the sentence 

(3x)(S(x)A(y y S(y)^(y = x)), 

which states that a A* contains a unique special vertex, and let I, be the princi- 
pal ideal of S(FO (A*)) generated by -.0.. Let S(FO (A*, 0.) = B(FO (A* ))/!.. 
Then there is an obvious isomorphism of Z?(FOi(A)) and B(FOq(A*), 0.), and a 
corresponding homeomorphism of 5(B(FOi(A))) and S(B(FOo(X' j), 0»). 

We consider the simple interpretation /. of A-structures in A*-structures, which 
maps a A*-structure Y defined as follows: let x ~ y be defined as [x ~ y) V (x = y) . 
Then 

• the domain of /. (Y) is defined by the formula 

h-l 

^6. V {3 Vl , ...,y h ) (R( yi ) A (y h — x\) A /\ {hS{ Vl ) V [ Vi — x\)) A ( W ~ y 4+ i)) ; 

• the relation R of I»(Y) is defined by the formula 

-.0. AR(xi)V9. A5(x x ). 

Then /, maps a colored rooted tree Y with a single special vertex v to the colored 
rooted tree Y(w). In a sake for simplicity, we denote by (Y,v) (where Y is a A- 
structure) the A*-structure obtained by adding the new relation S with v being the 
unique special vertex. 
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Lemma 46. For every sentence 4> G FOo(A) there exists a formula q(4>) G FOi(A), 
called relativization of (f>, with the following property: 

For every colored rooted tree Y and every v € Y it holds 

Y( u )|=0 ^ Y(= e (^)(«). 

Proof. According to the isomorphism of £?(FOi(A)) and S(FOo(A*), 0.), the lemma 
follows from the existence of J, (defined by the interpretation J.) such that 

Y(u)M (Y, U ) |= J.(# 

□ □ 

Definition 21. Let Encode : 2)^ -> W^®^ 5 )' be the mapping defined as 
follows: Let k be the integer such that the formula rj^ £ FOi(A) stating that the 
height of x\ is k belongs to T. Then Encode(T) = (Ti, . . . , T fc ), where T t is the set 
of all the sentences 9 such that g{8) A r\i belongs to T. 

Lemma 47. Encode is a homeomorphism of ' f^i and Encode^^), which is a 
closed subspace of l+j' i =1 (2)o' l ' ) ) 1 - 

Proof. This lemma is a direct consequence of Lemma |42| □ 

Definition 22. Let fi be a measure on We define v on Y/j as follows: let 

fi = Encode* (fi) be the push-forward of // by Encode. For t £ N we equip X t with 
uniform discrete probability measure if t < oo and the Haar probability measure 
if t = oo. For z € N , X z is equipped with the corresponding product measure, 
which we denote by X z . 

We define the measure v as follows: let A be a measurable subset of Vh, let 
A) = A n 2$°, and let A z = A n {F z x X*). Then 

v(A) = jl{Ao) + J^fa ® A 2 )(A Z ). 

(Notice that the sets A z are measurable as F z x Xj is measurable for every z.) 

Lemma 48. The measure /i is the push-forward of v by the projection P : Y/> — > 
3)i defined by 

P((T , T 1: a u ...,T a , a a )) = Encode" 1 ^, . . . , T„). 

Proof. First notice that P is indeed continuous. Let B be a measurable set of 2}^' l ' ) . 
Let A = P~ 1 {B). Then A(~](F Z x X z ) = (Encode(B) n F z ) x X z hence 

(/x® A z )(An (F z x X 2 )) = v(Encode(B) n F 2 )A 2 (X Z ) = /I(Encode(B) n 

It follows that 

P.(v)(B) = v{A) 

= /J(^n2)^ ) ) + ^(M® A,)(An(.F, xX z )) 

z 

= /7(Encode( J B) n Tj { Q h) ) + /x(Encode(.B) n F z ) 

Z 

= /7(Encode(B) n W |+J F,)) 

Z 

— Jlo Encode(B) 

= M (i?). 

(as z ranges over a countable set and as all the F z are measurable). Hence /i = 
P«(i/). □ □ 
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Lemma 49. Let Y n be a residual FOi -convergent sequence of colored rooted trees 
with height at most h, let fi be the limit measure of /iy„ on %± , and let Y be the 
connected component ofY^ containing the support of v. Then Y , equipped with the 
probability measure i/y — v , is a modeling FO-limit of (Y n ) n ^. 

Proof. As (Y n )„ g N is elementarily convergent, the complete theory of the elemen- 
tary limit of this sequence is the theory To to which every point of the support of 
\x projects. Hence the support of fi defines a unique connected compo nent of Y/i 
That Y is an FOi-modeling limit of (Y n )„ e N is a consequence of Lemmas 



That it is then an FO-modeling limit of (Y„)„ g n follows from Lemma 45 □ □ 
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10.4. The Modeling FO-Limit of a Sequence of Colored Rooted Trees. For 

an intuition of how the structure of a modeling FO-limit of a sequence of colored 
rooted trees with height at most h could look like, consider a modeling rooted 
colored tree Y. Obviously, the Y contains two kind of vertices: the heavy vertices 
v such that the subtree Y(v) of Y rooted at v has positive ^v-measure and the 
light vertices for which Y(i>) has zero ^v-measure. It is then immediate that heavy 
vertices of Y induce a countable rooted subtree with same root as Y. 
This suggest the following definitions. 

Definition 23. A rooted skeleton is a countable rooted tree S together with a 
mass function m : S — > (0, 1] such that m(r) = 1 (r is the root of S) and for every 
non-leaf vertex v € S it holds 

m(v) > m(u). 

u son of v 

Definition 24. Let (S,m) be a rooted skeleton, let Sq be the subset of S with 
vertices v such that m{v) = J2 U son of v m ( u )i let (&v)veS\S ^ e a countable se- 
quence of non-empty residual A-modeling indexed by S \ So, and let (R^)„ S 5 be 
a countable sequence of non empty countable colored rooted trees indexed by Sq. 
The grafting of (R v ) V £s\s an d (R-u)ueSo on (^> m ) is the modeling Y defined as 
follows: As a graph, Y is obtained by taking the disjoint union of S with the colored 
rooted trees R„ and then identifying d£S with the root of R„ . The sigma algebra 
Sy is defined as 

S Y = { |J M v U |J M' v : M v e S R „, M' v Ci?„} 

v<£S\So v£So 

and the measure iy(M) of M G E is defined by 

v£S\So u son of v 

where M = \J v es\s M « u LUs K wit h M v e S R „ and M' v C R v . 

Lemma 50. Let Y be obtained by grafting countable sequence of non-empty mod- 
eling colored rooted trees R„ on a rooted skeleton (S,m). Then Y is a modeling. 

Proof. We prove the statement by induction over the height of the rooted skele- 
ton. The statement obviously holds if S is a single vertex rooted tree (that is if 
height(S) = 1). Assume that the statement holds for rooted skeletons with height 
at most h, and let (S, m) be a rooted skeleton with height h + 1. 

Let s be the root of S and let {si : i G / C N} be the set of the sons of so in 
S. For i € J, Yi = Y(si) be the subtree of Y rooted at Sj, let Xi = J2 x gy m(x), 
and let be the mass function on Si defined by mi(v) = m{v)/\i. Also, let 
A = 1 - J2iei 
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For each i £ /U{0}, if Aj = (in which case R Si is only assumed to be a relational 
sample space) we turn R Si into a modeling by defining a probability measure on 
R Si concentrated on Sj. 

For i £ I, let Yj be obtained by grafting the R„ on (Sj, m*) (for v £ Si), and let 
Y be the A + -modeling consisting in a rooted colored forest with single (principal) 



component R So (that is: Yo = l_R_j,p(R S0 )). According to Lemma 18 Yo is a 
modeling, and by induction hypothesis each Yj (i £ I) is a modeling. According 
it follows that F = Uj:e/u{o}(Yi, Aj) is a modeling. Hence, according 
Y = If-vy(F) is a modeling. □ □ 



to Lemma 
to Lemma 



Our main theorem is the following. 

Theorem 26. Let (Y„)„ e g be an FO-convergent sequence of finite colored rooted 
trees with height at most h. 

Then there exists a skeleton (S,m) and a family (R v ) ve s — where R v is (iso- 
morphic to) a connected component ofY^, Sr„ is the induced a -algebra on R v - 
with the property that the grafting Y of the R t , on (S,m) is a modeling FO-limit 
of the sequence (Y„)„gN- 



Proof. First notice that the statement obviously holds if lim„_ i . 00 < oo as then 
the sequence is eventually constant to a finite colored rooted tree Y: we can let 
S be Y (without the colors), m be the uniform weight (m(v) = 1/\Y\), and R„ 
be single vertex rooted tree whose root's color is the color of v in Y. So, we can 
assume that lim„_ i . 00 \ Y n \ = oo. 

We prove the statement by induction over the height bound h. For h = 1, each 
Y„ is a single vertex colored rooted tree, and the statement obviously holds. 

Assume that the statements holds for h = ho — 1 > 1 and let finite colored 
rooted trees with height at most ho- Let F n = ly_).jr(Y n ). Then (F n ), ig n is FO- 



convergent (according to Lemma 18 1. According to the Comb Structure Theorem, 
there exists countably many convergent sequences CY n ,i)neN of colored rooted trees 
(for i £ I) and an FO-convergent sequence (R„)„ g n of special rooted forests forming 
a uniformly convergent family of sequences, such that ly_>F (Yn) = -^-n Uljjgj Y n i . 
If the limit spectrum of (ly->F(Y n ))„ e N is empty (i.e. I = 0), the sequence 



(Y n ) n£ N °f colored rooted trees is residual, and the result follows from Lemma 49 
Otherwise, let (Ai)j £ / the limit spectrum of (ly->.F(Y, i ))„gN, let Ao = 1 — 
IZie/Aj, and let Y n ,o = ln->p ° lF->y(R«)- If A = then there is a connected 
component Yo of Y/j that is an elementary limit of (Y^o^eN; Otherwise, as 



(lF^y(Rn))nGN is residual, (Y nj o)„gN has, according to Lemma 49 a modeling 
FO-limit Y . By induction, each (Y n i ) ng p} has a modeling FO-limit Yj. As Y n = 
'-F-s-y(Uie/u{o} Y n ,i), we deduce, by Corollary |3j Lemma 31 Theorem |TTj and 



Lemma 



18 



that (Y„)„ eN has modeling FO-limit lF^y(II ie /u{ }( Y i, 1=1 1=1 



So, in the case of colored rooted trees with bounded height, we have constructed 
an explicit relational sample space that allows to pullback the limit measure \x 
defined on the Stone space S(23(FO)). 

11. Limit of Graphs with Bounded Tree-depth 

Let Y be a rooted forest. The vertex x is an ancestor of y in Y if x belongs 
to the path linking y and the root of the tree of Y to which y belongs to. The 
closure Clos(Y) of a rooted forest Y is the graph with vertex set V(Y) and edge 
set {{x,y} : x is an ancestor of y in Y, x ^ y}. The height of a rooted forest is 
the maximum number of vertices in a path having a root as an extremity. The 
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tree-depth td(G) of a graph G is the minimum height of a rooted forest Y such 
that G C Clos(Y). This notion is defined in 50] and studied in detail in [61]. In 
particular, graphs with bounded tree-depth serve as building blocks for low tree- 
depth decompositions, see [51, 52. 53 . It is easily checked that for each integer t the 
property td(G) < t is first-order definable. It follows that for each integer t there 
exists a first-order formula £ with a single free variable such that for every graph 
G and every vertex v € G it holds: 

G(=f(w) <S=> td(G) < i and td(G-u) < td(G). 

Let t € N. We define the basic interpretation scheme l t , which interprets the 
class of connected graphs with tree-depth at most t in the class of 2 t_1 -colored 
rooted trees: given a 2 t_1 -colored rooted tree Y (where colors are coded by t — 1 
unary relations Gi, . . . , Ct-i), the vertices u,v G Y are adjacent in lt(Y) if the 
there is an integer i in 1, . . . , t — 1 such that Y |= Ci(v) and u is the ancestor of v 
at height i or Y |= Ci(u) and v is the ancestor of u at height i. 

Theorem 27. Lei (G„)„gN <fi FO-convergent sequence of finite colored graphs 
with tree-depth at most h. 

Then there exists a modeling G with tree-depth at most h that is a modeling 
FO-limit of the sequence (G„)„ e pj. 



Proof. For each G n , there is a colored rooted tree Y„ with height at most h such 
that G„ = l/,(Y n ). By compactness, the sequence (Y„) ne fj has a converging subse- 



quence (Yj n ) rae N, which admits a modeling FO-limit Y (according to Theorem 26) 



and it follows from Lemma 18 that Ifc(Y) is a modeling FO-limit (with tree-depth 
at most h) of the sequence (Gi n )n£N, hence a modeling FO-limit of the sequence 

(G„) raS N- □ □ 

12. Concluding Remarks 

12.1. Selected Problems. The theory developed here is open ended and we hope 
that it will encourage further researches. Here we list a sample of related problems 
The first two problems concern existence of modeling FO-limits. 

Problem 1 . Is it true that every FO-convergent sequence of finite relational struc- 
tures admit a modeling FO-limit? 

In particular, it follows from Theorem [13] that there exists an FO-convergent 
sequence (G n )„ S N such that (G n ) n ^ converges elementarily to the Rado graph and 
{G n )neN is L-convergent to the constant graphon 1/2. This suggests the following 
problem. 

Problem 2. Does there exist modeling FO-limit G for G(n, 1/2), that is a modeling 
such that G is elementarily equivalent to the Rado graph and for every finite labeled 
graph F with vertex set {v\, . . . , v p } it holds 

^g^{(^i, • ■ • i Xp) G G p : Vi H> Xi is isomorphism of F and G[x\, . . . , x p ]}^j = 2~( 2 )? 

Aldous-Lyons conjecture [3] states that every unimodular distribution on rooted 
countable graphs with bouded degree is the limit of a bounded degree graph se- 
quence. One of the reformulations of this conjecture is that every graphing is an 
pQiocai jj m j t £ a se q uence f finite graphs. The importance of this conjecture ap- 
pears, for instance, in the fact that it would imply that all groups are sofic, which 
would prove a number of famous conjectures which are proved for sofic groups but 
still open for all groups. 
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The two next problems are related to this conjecture: the first one concerns 
a possible strengthening of the conjecture, and the second one is concerned with 
looking for an analog for rooted colored trees with bounded height. 

Problem 3. Is every graphing G with the finite model property an FO-limit of a 
sequence of finite graphs? 

In the case of colored rooted trees with bounded height, we have constructed an 
explicit relational sample space that allows to pullback the limit measure /i defined 
on the Stone space S(B(FO)). However, we still cannot fully characterize limits of 
colored rooted forests with bounded height. According to our construction, a full 
characterization would follow to a solution of the following problem. 

Problem 4. Characterize the measures fi on S(B(FOi)) that are limits of residual 
FOi-convergent sequences of colored rooted trees with bounded height. 

12.2. Classes with bounded SC-depth. We can generalize our main construc- 
tion of limits to other tree-like classes. For example, in a similar way that we ob- 
tained a modeling FO-limit for FO-convergent sequences of graphs with bounded 
tree-depth, it is possible to get a modeling FO-limit for FO-convergent sequences 

of graphs with bounded SC-depth, where SC-depth is defined as follows [31] : 

y 

Let G be a graph and let X C V{G). We denote by G the graph G" with 
vertex set V(G) where x ^ y are adjacent in G' if (i) either {x,y} £ E{G) and 

{x, y} 2 or (ii) {^i y} ^ E(G) and {x, y} C X. In other words, G is the graph 
obtained from G by complementing the edges on X. 

Definition 25 (SC-depth). We define inductively the class SC{n) as follows: 

• We let 5(7(0) = {^i}; 

• if G±, . . . , G p G SC(n) and H = G\(j . . . i)G p denotes the disjoint union of 

x 

the Gi, then for every subset X of vertices of H we have H g SC(n + 1). 
The SC-depth of G is the minimum integer n such that G £ SC{n). 

12.3. Classes with bounded expansion. A graph H is a shallow topological 
minor of a graph G at depth t if some < 2£-subdivision of H is a subgraph of G. 
For a class C of graphs we denote by C V t the class of all shallow topological minors 
at depth t of graphs in C. The class C has bounded expansion if, for each t > 0, the 
average degrees of the graphs in the class C V t is bounded, that is (denoting d(G) 
the average degree of a graph G): 

(Vi > 0) sup d(G) < oo. 
Gee v t 

The notion of classes with bounded expansion were introduced by the authors in [3H1 
HI EE] , and their properties further studied in[51[S3[T71[I3[Sl[5a[5aiMlinil[Sa 
and in the monograph |60| . Particularly, classes with bounded expansion include 
classes excluding a topological minor, like classes with bounded maximum degree, 
planar graphs, proper minor closed classes, etc. 

Classes with bounded expansion have the characteristic property that they admit 
special decompositions — the so-called low tree-depth decompositions — related to 
tree-depth: 

Theorem 28 ([H3[5T]). Let C be a class of graph. Then C has bounded expansion 
if and only if for every integer p £ N there exists N(p) £ N such that the vertex set 
of every graph G £ C can be partitioned into at most N(p) parts in such a way that 
the subgraph of G induced by any i < p parts has tree-depth at most i. 
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This decomposition theorem is the core of linear-time first-order model checking 
algorithm proposed by Dvorak, Krai', and Thomas [HI [21]. In their survey on 
methods for algorithmic meta-theorems |32) . Grohe and Kreutzer proved that (in 
a class with bounded expansion) it is possible eliminate a universal quantification 
by means of the additions of a bounded number of new relations while preserving 
the Gaifman graph of the structure. 

By an inductive argument, we deduce that for every integer p, r and every class 
C of A-structure with bounded expansion, there is a signature A + D A, such that 
every A-structure A £ C can be lifted into a A + -structure A + with same Gaifman 
graph, in such a way that for every first-order formula 4> S FO p (A) with quantifier 
rank at most r there is an existential formula <f> £ FO p (A + ) such that for every 
Vi, ■ ■ ■ , v p £ A it holds 

A |= 4>{v\, ... ,v p ) A+ \=^(v 1 ,...,v p ). 

Moreover, by considering a slightly stronger notion of lift if necessary, we can assume 
that is a local formula. We deduce that there is an integer q = q(C,p,r) such 
that checking <j>(vi, . . . , v p ) can be done by considering satisfaction of ip(vi, . . . , v p ) 
in subgraphs induced by q color classes of a bounded coloration. Using a low-tree 
depth decomposition (and putting the corresponding colors in the signature A+), 
we get that there exists finitely many induced substructures Aj (I £ ( ^ )) with 
tree-depth at most q and the property that for every first-order formula <f> £ FO p (A) 
with quantifier rank at most r there is an existential formula (f> £ FO p (A + ) such 
that for every v\ , . . . , v p £ A with set of colors Iq C I it holds 

A \= ( p(v 1 ,...,v p ) 37 G fJ^D : A iu/ N <t>(vi,-.-,v p ). 

Moreover, the Stone pairing (0, A) can be computed by inclusion/exclusion from 
stone pairings ((f>, Aj) for I £ (<^). 

Thus, if we consider an FO converging-sequence (A„) ne pf, the tuple of limits of 
the A + -structures (A„)| behaves as a kind of approximation of the limit of the 
A-structures A n . We believe that this presents a road map for considering more 
general limits of sparse graphs. 
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